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I. INTRODUCTION 


By A. HISTORICAL BACKGECUND 
cate 
IN During the Presidential Administration of John F. 
‘ Kennedy, Secretary of Defense Robert S. McNamara instituted 
re a major revision for management of defense resources. These 
ws procedures were instituted as a revolution to the silitary 
aa Frocurement 3ysten. Among the revisions he instituted were 
ai the Planning, Progragsing and Budgeting System and a manage- 
es ment system for acquisition of new major systems. 
» The igpact of these new procedures on the military was 
1 to create an immediate need for extensive education of the 


a armed services" acquisition organizations. The perscnnel in 
charge of ongoing system procurements, the project managers, 
needed a means of being educated about the systen. New 


nay 
a Atst personnel to the field of acquisition also had to have a 
ay gweans of learning abcut the systen. 

oo In response to the services need, in 1963 the Defense 

es Weapons Systems Management Center developed the Project 
iat Management Simulation Exercise (PMSE) to aid in DOD-wide 
i. training in project sanagenment. The exercise sinulated 
ang procurement of a missile system to aid the DOD-wide training 

* in PPES. 

x In the later 1960*%s, the Industrial College of the Armed 
ze Forces (ICAF) oktained the sinulation and revised it into 
“ the Defense Management Simulation (DMS). DMS was installed 
a4 at the Naval Postgraduate School in 1971. 

wea The exercise currently has international application. It 

— is used ty Israel, Sweden and Singapore to train their 
BS defense personnel in the use of acquisition sanagement 

ea systegs. 


et OIG RLS Le nOnOnee 


etal eT, it ee ae Se 8 Se i es eee ee, ee 


“p>. Agencies within the U. S. government currently using CMS 
“ i. ‘ oN 2 2 . . 
paasS or related products for training exercises include: 


e Industrial College of the Armed Forces | 
e Naval Postgraduate School 
e U. S. Air Force Acadeny 

It is this wide accertance which has maintained DMS as an 

active sanagement training exercise. 

Be. SCERARIC 


The exercise developed by DWSMC in 1963 consisted of a 
time~sequenced set of decision points in the life cycle of a 
wissile system acquisition (see Figure 1.1). The decision 
points (DPs) simulate the equivalent functions of these 


major silestones in the system life cycle. Within a 
prescribed time period each team of students participating 
ek in the exercise reviews the information materials for the 
ry specific decision point and submits its decision for recca- 


mended action at that point in the game, as would be dore in 
actuality. The abjective is to optimize the cost effective- 
ness for procurement, production and development of the 
proposed new missile system, the Zebra Missile Systea. 
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C. SISULATION 


The team recoamendations reguire monitor evaluaticn. 
Monitcrs review the student recommended performance reli- 
abilities, costs, ince ntives,  Gontractor selection 
Frocesses, milestone dates and fees. They prepare materials 
for teams to interact with as they would with the Secretary 
of Defense and with the contractor. An extensive study of 
the materials from each tearm is required by the monitor. 

In order for the sonitors to not spend as much tine on 
the sisulation as the students, the monitors need aid in 
processing the team data. ICAF developed an Fortran program 
called Contract Negotiation fPackage (CNP) to assist the 
monitor in the evaluation of student team contract 
negotiations. 

The DMS prograga is amore than twenty years old. The 
program has experienced several sodifications and offshcots. 
Its 1960's prograasing state-of-the-art remains rostly 
intact. By 1984 standards of ease of operation and user- 
friendliness, it is difficult to utilize. 

Efforts to aodify the program occurred in 1972 and in 
1977. The first atterapt to upgrade the DMS program in 172 


modified several internal algorithas and produced an 


effshcot program which provided fewer but amore rapid 
results. In 1977 this version of the program, the Contract 
Negotiation Package, was again revised. This later revision 
provided predictions of achieved values to the student 
teaas. 

Team access to the prograa's simulated results grew out 
of the acdernization cf sanagesent processes. Managers are 
using the tenefits cf sodern computer systems to iapfrcve 
their own performance. Student team use of the CNP prograa 
for the DMS exercise was a logical evolution. CNP use by the 
teaus enables the DMS exercise to reach the level of current 
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85 Rader project sanagement technological support in computer-aided 

a NESE acquisition management techniques. The program also remains 

‘yp, abreast through student and aonitor interest in maintaining 

‘ _ the progragm at the ccauputer support state-of-the-art. 

RP, The CNP program available on the IBM-3033 in the W. BR. 

Church Ccasputer Center at the Naval Postgraduate Schcol 

ey, campus is discussed further in Chapter 2. Its disflays 

: reveal CNP's batch frogras origins. The data input and 

ee output fcrmats are batch processing type fields. The lack of 

we interactive capability typifies a program which is tatch 
processed. In its batch processing use, the computer did not 
have terrginals or users with ‘which to interact. Originally 


CNP had no hardware capable of directly interacting with the 
By users and its design developed accordingly. 

Modern senu-driven designs have made user-friendly 
3 programming standard practice. As a viable training exercise 


Rs: for acquisition management, the DMS gage continues’ to be 
oN 25 valuatle. In order to maintain its wide acceptance and 
ry expand its efficient utilization, a aajor revision to the 
4 progras is needed. 
The following chapters discuss a package of programs 
i designed to give CNP an improved interactive program 
capability. 
D. SOSMARY 


The DMS training pregram incorporates an exercise which 


Re Simulates a project management scenario. DAS is a 
nsf successful training device which has been in use for 20 
+S years. In support cf DMS, the Fortran computer progragz CNP 
Mi was develored to frovide computer-aided assistance for 


gonitcr evaluation cf teas performance. Later, CNP was 
released to the student teams in a format which frovides 
them with siaulated performance data. It enakles teas 
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so) interaction with the computer. In so interacting, the tean 
gains experience using the computer as an analysis tcol and 
to perform sensitivity analysis ("what if questions") on 
major freject performance and incentive parameters. AS a 
result of CNP's age, its design did not permit adequate 
interactive capability for easy operation. In order to 
resolve the need for greater user-friendliness in CNF, this 
thesis develops, studies and reports on a CNP program revi- 
Sion entitled PRCJMNG FORTRAN. 
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a II. CNP OPERATION ! 
2: i 
oF Ae PROCEDURES | 
a Proficient use of the Contract Negotiation Program (CNP) 
a depends upon the user's familiarity with both the couputer 
ny facilities and with the instructions in Appendix A. The 
rf “Defense Management Simulation Instructions for Using CNP" 
of presents computer terminal display lines as seen during a 

terminal session. In following sequentially through the 


instructions, difficulties are apparent with the program 
both in user-friendliness and in design. Appendix A deacn- 
etrates a session in CNP, and pertains to the fcllcwing 


pert discussion cf that prcegraa. 

"3 The procedures for accessing CNP require the oferatcr to 
_ link to the monitor's class disk, then to access the disk, 
SRT and finally to execute CNP. Accessing the program in this 


manner ncraally requires at least a conceptual knowledge of 
computer cosmand and response terminology. In the event of 


* 
e an accessing aalfunction, or if the monitor is using the CNP 
cn Frogram's class disk and prevents read-only execution of the 


disk files, the user may be confronted with unfasiliar 
i terminology. He would need sore than a casual knowledge of 
es computer operaticn tc proceed into CNP. 

The first functicn performed by CNP is to input adainis- 
trative data. Included in the adaginistrative data are the 
team numter, the decision point (DP), and the DP pages for 
which data are to te entered. Coaplications with the 
program quickly arise with these procedures. The data aust 
be input in the exact format prescribed on the instruction 
sheet. Too many digits, er too many spaces in the data 
result in erroneous output, and/or error statesents. Each 
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page's data string reguires confirmation. This tLeconmes 
laborious in repeated runs of the program, or repeated 
executicas of the calculations for a Summary Table, TIable I. 

Frequently explanation is required for the procedure of 
binary coded response to the guery for pages of data to be 
entered. Coding the page selection for data input can be 
confusing. Fach of the four pages requiring input data must 
ke indicated by ‘1*(cn) or ‘O"(off) in the four digit code 
string. Indicating the page number in Arabic characters 
would te a more comgponly expected procedure. Again, an 
error in entry is irrevocable. The change rages cannct be 
rescinded orce the binary code has been entered. 

Having completed the administrative inputs, the tean 
proceeds with providing its proposed DP data. Prior to 
running CHP, team participants are to have used the DsS 
Decisicn Paint handouts ( see Appendix 3) to determine and 
analyze their tentative DP jpositions. These results are 
listed as data lines in the DMS Decision Point Sheets, 
(Appendix 8). Bach character in the page's data lines 
requires precise replication when placed in the page data 
string input to CNP. The program types the page's data back 
onto the screen and asks for confirmation. Through 
reloopring to the query for rages of input, the progragm does 
allow rcevision of data. However, each data iter to be 
changed reguires an entire page change. The teas is 
confronted with reentering the data string each tine. This 
procedure has proven to be tedious. It frequently results 


‘in teaas redoing data strings several times to get then 


correct Lefcre a calculation of achieved values can te sade. 
Successive loops through the program have the added check 
feature cf receiving a four line printout of the page data 
for confirmation. The redundant queries for confirmaticn of 
data values have benefit in reduciag erroneous data calcula- 
tions, (see Table II ). 
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ca The Development Ccntract Summary Table, Table I , neatly 
335 displays the decisicn point incentive input data as_ the 
vy, "Incentive Provisions’. Cnly five calculated values are 
ig! displayed to the tear. They are the achieved values for 
ee develcraent cost, flight test completion date, reliability, 
Re accuracy, and total contract price. Also, displayed on the 
Katee Suamary Table is the computed total of fee percentages cbli- 
Roney gated. The total fees allocated aust be 15%. Allocaticn of 


fees to other than 15% results in a warning on the Surmary 
2. Table. the significance of the Development Contract Susaary 
table and CNP rests in these five achieved values. 
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10301 1 1 2 1.75 0.75 0.0 


10302 92.00 97.00 98.50 80.00 70.00 25.00 6.00 
3.00 3.€0 6.00 £17.00 

10303 3.00 47.00 4.00 238.00 202.00 3.50 81.00 
75.00 3.50 


6 
10304 160.00 140.00 4.00 337.00 | 


Ccmupared with the original CNP design, there are missing 
values from the Sumsary Table. It does not print out ten 
additional calculated values: the fee percentages achieved, 
their fee cost, and the totals of fees earned and of fees 


cost. These values were suppressed from the original 
ite program table due to their computation by incorrect algo- 
rithas. They're suppression is evidenced by the dcllar 


signs at the right of the Summary Table. 

To reloop through the input of data and receive ancther 
estimate of the achieved values, the team answers an unes- 
sential query. This guestion has no application to the 
teas. The "COSTS¢FACTORS( WO)" query provides sonitor 
access to the tables cf design performance factors achieved 
and test costs in the form of unit change cost factors. the 
team’s nce("'N*) rcespcnse to, or an incorrect response to, 
this query reloops the program to the top of the asain 
routine. Again, each question: decision point, tean, 
pages, data, yes or no, and confira aust be answered. 

It is extremely difficult to exit from the prograa if 
the tearm attemupts tc stop at any poiat before the relicop 
query. At the query "DO YOU WISH TO CONTINUE, Y FOR YFS, N 


or 
aR 21 


' 7 


,. * ae » aus . wet ow 4 8 
FF PPPS De Oe ee 


FOR NC*, the program provides its only graceful exit. Any 
cther attemrts to exit the program must be accomplished by 
dumping (stepping) the prograa. Inputs that do nct match 
the data types required for data read-statement formats 
result in error statements, and with sufficient error occur- 
rence count the frogram will dump. 


Be. BENEFITS 


The benefits for team utilization of CNP are in its 
ability to provide scme semblance of the achieved values 
which the main DMS batch program, provides. In so dcing, 
the team uses the computer as a tool with which to view the 
sensitivity of its incentivization parameters. It can eval- 
uate effects of varying available DMS critical incentive 
parameters: develorment cost, flight test completion date, 
reliability, accuracy and development contract price. This 
aspect of analysis simulates the real world potential for 
computers to expedite the computations andas a tool in 
these assessments. It further provides an envircament in 
which team particisation and success depends on under- 
standing the system acquisition concepts that DMS illus- 
trates. In order to expeditiously vary the parameters 
within the computer the team must have competent knowledge 
of these DMS concepts. 

CNP*'s best feature appears in its structure. It closely 
follows the procedures in the DMS Decision Point Handouts, ! 
Froa its inception as an offshoot of the main CMS frogran, 
it has inherently fcllowed the decision point sequence and 
structure of DMS. 
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The wide acceptance of CNP at many institutions can be 
found in the attributes it brought to DMS. In meeting the 
objectives of providing a program with the ability to 


quickly reloop through computations, and the ability to be 
operated frcm a terminal, the program fuifills a major need 
in performing certain sensitivity analyses over the DMS 
prograag. Once accessed, the program can be rerun innuper- 
able times without ccspletely reinputting all the data. The 
data inputs can te accomplished from a terminal. Computer 
support for DMS on computer terminals has made DMS acces- 
sible to more users without adding expense. It has enabled 
Many students to simultaneously utilize DMS as a tool in 
acquisition management training. 


C. DEFICIENCIES 


Areas which need iagprovement in CNP focus on user- 
friendliness. The first of these is the inability to grace- 
fully exit from the frograa. Some means gust be availatle 
to permit the team to stop the prograa. Currently the 
program can only be stopped by expending time to finish the 
session or by generating sufficient syntax errors tc force 
the ccuputer to dump the progran. In some cases, sessions 
have been in sufficient difficulty that the program would 
not reach the query "DO YOU WISH TO CONTINUE...". For this 
situation the team is forced to generate error counts waich 
will dump the progras. These situations have been exceed- 
ingly frustrating for the program users. 

A means to change data entries without redoing entire 
pages is needed. The team aust completely redo a DP page ia 
order to change one data ites. Changing one ites should 
enly reguire reentering one value. Additionally, data 
strings from one decision foint to another are not readily 
duplicated for input. Similar strings of data for pages on 
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DP-3 and DP-4 do not have the same field format. Matching 
field formats for identical pages in different D?'s would 
enhance the ability cf teams to input data strings. 

CNP receives all of the input data but cannot retain it 
tetween sessions. The team starts froma baseline cf no 
data each time CNP is called. Most significant of the 
changes needed to mcdernize CNP is the creation of a data- 
kase file to retain team data from session to session. A 
foundaticn data base of the initial paged input could 
Frovide a means of replicating session results, of docu- 
menting ¢ata inputs, and of proceeding to successive DP 
levels without labcriously reentering previously studied 
data. 

Excessive recurrences of calculating the Summary Tatle 
could be eliminated to save team time in the program. 
Preventing runs which produce Summary Tables without correct 
incentive fee percentage totals would reduce wasted program 
run time. Utilizing data that does not meet the DMS parame- 
ters calculates errcneous values, and may provide Summary 
Tables which mislead the tean. Repeatedly running calcula- 
tions to evaluate wide ranges of parameter values without 
conducting proper preliminary analyses not only detracts 
from the timeliness of the DMS studies, it defeats the 
purpose cf DMS training teams to understand the concepts of 
project sanagenent. Teams have occasionally found greater 
ease in working thrcugh the program and produce a Summary 
Table in order to reach the "DO YOU WISH TO CONTINUE...?" 
query as an expedient to reloop through or exit from the 
program. This process detracts from the educational benefit 
and timeliness of DMS. 

As part of the training simulation, monitors spend many 
hours in analyzing the progress of the teams and the fosi- 
tions for ccntract negotiation. Analysis done by each tean 
must also be accomplished by the monitor to assess student 


Do. SCHITOR FUNCTIONS 


CNP provides ene additional table for menitors. 
COS T#FACIORS, Table III , provides the monitor with the ccst 
for a unit increase in a system test category as wvell as 
with the design factors achieved. 


TABLE III 
COST # FACTORS 


CCSTS OF TESTS PEE UNIT (IN THOUSANDS OF DOLLARS) 
CUALIFICATION TESTS 
MOTO 


Eo: 32.034 

AIR FRAME 3 126.355. 

GUIDANCE ;: 309.906 

FIEE Corr Ect ¢ 938.186 

LAUNCHER ; 424.555 

FLIGHT TESTS 3: 316.855 
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ee progress. The monitor must also create positions frem which 
aan to interact with the teams as the contractor. Within the 
wit COST#FACIORS Table, some aid exists for the sonitor. 
oer ; However, his understanding cf the impact of unit-cost on the 
ie contract requires additional analysis time over what the 
Ss teams spend on incentives analysis. In general, because of 

oy limited time the monitor has to spend analyzing each teaa‘s 
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propcesals ccmpared sith the amount of time put in Ey the 
team, ccupled with the inconvenience in making repeated CNP 
runs, most monitors produce an actual DMS table printout 
corresponding to each team's froposed decision in crder to 
Frovide more detailed and accurate information for use 
during centract negotiations. It would be better fcr CNP to 
frovide the information ina more usable format than to 
froduce the lengthy and time consuming main exercise rerorts 
of the DMS. 


E. SUMMARY 


The difficulties encountered in CNP detract from its 
usefulness. Time spent fighting the program problems are 
excessive ccmpared tc the hours available for productive DMS 
analysis. In an effcrt to correct these time-sinks in CNP, 
FROJMNG FCRIRAN and its associated EXEC routines have been 
created. 


III. PROJNNG OPERATION 


Aw CEP HODERNIZATION 


The task in creating PROJMNG FORTRAN as a revision to 
CNP was first to retain the same functional structure rela- 
tionship with DMS. This goal has been accomplished by 
incorforating the CNP subroutines into a larger frogran. 
The expansion has occurred by the added Fortran code for the 
human-factors engineered subroutines, and new sensitivity 
analysis features. the human-factors designs provide addi- 
tional user friendliness to PROJMNG. The program calcula- 
tions continue to center around the original CNP program 
routines. Many of the achieved value parameters and 
perfcrmance calculations are accomplished using the same 
Fortran code as used Ly CNP. CNP is encompassed in PROJMNG. 

Other tasks for FROJMNG FORTRAN were to correct as many 
of the discrepancies in CNP as possible, to provide an 
enhanced user-friendly training device and to improve the 
analysis capability available to the monitor. 

In modernizing CNP, the criticisus specified in Chapter 
2 were highlighted. the following areas were examined. 


1. Link 
2. Datatase 
3. Database Security 


4. Exit 

5. Data Change 

6. Menu 

7. Report Subsission 
ras - 
as 8. Mecnitor Access 
oe 9. Sensitivity Aralysis 
Oe 10. Calculation Correction 
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B. PROJEEG PACKAGE 


This chapter discusses the features of PEOJMNG used to 
support team analysis of the exercise. The monitor capabili- 
ties are discussed in Chaoter 4. 


1. PEggrass 


FROJMNG consists of more files (executable prograuss) 
than does CNP. There are four routines utilized in 
executing PSOJMNG FCRIRAN. In addition to the FE&CJMNG 
FORTRAN file, the package includes LINKPROJ EXEC (Appendix 
Cc). PRCJMNG EXEC (Appendix [), and the PROJMNG disk's 
PROFILE FXEC (Appendix £) which are discussed in detail 
throughout this thesis. 

FROJMNG FORTRAN is designed to function alcne 
provided team files exist and have been defined for PRCJMNG 
FORTRAN as files 9 and 10: "“FILEDEF 09 DISK DATAFILE TEAMxx" 
and "FILEDEF 10 DISK DATACODE TEAMxx". It can rte used 
without the exec rottines but at a lower level of rerforna- 
ance. PROJMNG can ke executed through the routine PRCJMNG 
EXEC. 

PROJMNG FORTRAN and PROJMNG EXEC are designed to 
reside on a publicly accessible disk. In this manner 
multiple teams can use the program siauitaneously. Their 
database files will be on this one disk where they are 
conveniently accessitle for the program and the monitors. 
PROJMNG is read frog this disk by the team's user disk and 
executed fren the tean's disk. 

FROJMNNG Eoth reads and writes onto its data files. 
The IBN-3033 public, "all", link access is read-only (R/O) 
and prevents writing onto the disk. The PROJMNG disk is 
only read capable when linked to for the exercise. However, 
the disk linking to PROJMNG can be written onto by the 
prograa. A team disk linking to PROJMNG acts as the write 
disk fer the prograa. 
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the ability for teams to write directly ontc the 
PROJMNG disk would te unsatisfactory. This access’ to the 
Frogram would perrmit two detrimental effects. The pregraa 
Sight be either altered or destroyed by overly ‘curious 
students entering the files, and team files might also be 
altered or destroyed. Inadvertent alteration of the files 
is prevented by student access being limited to read only. 


2- fata files 


There are fcur files of data tables that were 
created for CNP. These tables contain the resource parane- 
ters to generate achieved values for the program calcula- 
tions. These data tables remain in files FI17¥F001, 
FT18FO01, FTI9FO01, and FT20F001 as in CNP. No contract 
Simulaticn calculaticns can be accomplished without then. 
The progras will dusp when it reguires a table be read and 
does not find it. PFCJMNG will also stop if the tables are 
not in the required fcraat. 

Ereformatted catabase files must be availatle when 
the STORE and read rcutines are called by PROJMNG. Whenever 
it attemrts to write or read these data files and does not 
find them, the program will dump (stop). Two of the 
remaining files are these datatase files. One is the FILE 
DATAFILE which is preformatted for the DMS data. It serves 
as a dumgy file which can te copied to initiate the teas's 
database, DATAFILE TEAMxx. The other file, FILE CATACODE, 
serves as a Similar dummy file in the creation of the tean's 
security file, DATACCLE TEAMxx. 

CATACODE stores the team security code, the security 
code count for attempts to -Ereech the code, and the USERID 
of the last team which used the file. Its data enakles the 
program to use routines to check the team and validate the 
team identity through the security code. 
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bee AR If formatted files for the team are not available on 
r — the PROJMNNG disk or the team disk, the dummy files are 
Pee copied onto the team disk. PROJMNG EXEC reproduces the two 
sts, duany files on the team disk in the names’ DATAFILE TEAMxx 
a and DATACODE TEAMxx. They are used interactively by PRCJMNG 
oh during the gase sessions. The PROJMNG Instructions 
4 (Appendix F) discuss the DATABASE and DATACODE file genera- 


tion cn the teaa's disk. 
When the teas finishes its session and exits fron 


me PROJMNNG FORTRAN, the last copy of the data which was stored 
coe ky the program remains on the teaa's disk. As the comrfuter 
Res executicn finishes the routine PRCJMNG EXEC, these two files 
2 are tranesitted to the PROJMNG disk. 
wes 
> 3. LIEK 
ts LINKPROJ establishes the link between the tean's 
uA disk and the PROJMNG disk. It requires PROJMNG EXEC in 
“ Le\S 

: order to run the prograr. 


The routine LINKPRCJ is a CMS executive level 
prograga which utilizes the link feature to establish the 
connecticn tetween the teaa's disk and the disk on which 
PROJMNG resides. It begins the recording of the team's 
session, “RECORD ON". This first step in LINKPROJ provides 
a record of the sessicn for review in the event PROJMNG dces 
not perforsa as desired. Once the link has been estaktlished, 
the routine sets the function of the programmable function 
key 9 (PF9) to enakle release of the link. This feature 
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ae enables the teas to release the link after a session has 
mt been akrorted and the frogras stopped without completing the 
Bog LINKPROJ EXEC. -The team would have to abort a_ session 


should PECJMNG be stuck in a continuous loop.~ PFI will not 
succeed in breaking the link when PROJMNG is operating 
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Team members should be aware of the IBM~3023 cara- 
bility to te dumped (stopped) out of CMS by executing 
<KALTD>> and <<PA1I>> sinultaneously. Executing <<FA1>> 
aborts the program without completing LINKPROJ. The 
pressing of these two keys on the I3M 3278 terminals will 
Place tte virtual systerz into the CP level of operator 
interaction. The teas can reaccess its "A" disk by executing 
the ccumand “I CMS" and pressing <<ENTER>>; wait for the 
display to read "VM READ" and again press <<ENTER>>. The 
disk will again be in CMS and existing links will remain 
intact. In order to release the link to PROJMNG press the 
<<ALT>> and <<PF9>> simultaneously. 

LINKPROJ breaks the link. It releases the PRCJMNG 
disk (0276P). Once the disk is released if no users are 
accessed to it, the FROJMNG disk can be logged onto in the 
readywrite sode to enable files to be written onto it. 

When LINKP&ROJ sends the special message to PHCJMNG's 
disk, “SSG QACNT KLINE" it tells the computer to automati- 
cally log (autolcg) onto the disk. The disk is activated 
in the read/write acde only if no other user is on the 
FROJMNG disk. The files which the team sent are copied by 
the disk‘'s FROFILE EXEC. 

LINKPROJ alse terminates the recording of the 
session, "RECORD OFF". 


4. PROJENG EXEC 
a. Initiate Files 


PROJMNG EXEIC perforgs the checks of availatle 
files. It determines if a formatted data file and a 
security file are available for the team. If it detects the 
gwonitor ctnigue file, DATAINST DISKNUM, it initiates the 
monitor flag to tell EFROJMNG FORTRAN the user is a rnonitor. 
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oy Ae PROJNNG EXEC checks first for the acnitor's 
a a file, determines if the user is a team or a monitor. If the 
eee user is a team, it checks for the teaa files on the PRCJMNG 
Ro disk and uses them if available. If these files are not 
oi found, it will check the teams disk for the files and use 
my them. If the files are not found at all, the prograsr ccpies 
Se the dumsy files and generates the team label and files. 

ug bt. Terminating the Session 

ot If the user is a aonitor, PKOJMNG EXEC queries 
ACS him for whether he desires a concatenated listing of all of 
qo the team files. If he does, it spools'a file with all teas 
ys data files on it. It then completes its execution and 
oe returns operation to LINKPROJ. 


For tearm operation, when the computer leaves 

FROJMNG FORTRAN control, execution returns to PROJMNG EXEC. 

ad In order to coapflete the session, PROJMNG EXEC has been 

° a designed to transait the data files to the PROJMNG disk. 

This feature is acccsplished by spooling the disk, "SPCOL 

rte, PUNCH CONT CL X 0276E". The funch file created is sent to 

a userid 0276F as a class x file. PROJMNG EXEC punches the 

* data files onto the spool, "PUNCH DATAFILE TEAMxx", and 

at closes the spool, "“SFOOL PUNCH CLOSE NOCONT". The file is 
a gueued in the reader file of the PROJMNG disk (0276P). 


ah 5+ ERBOFILE EXEC 

When LINKPROJ sends the automatic log-on aessage to 
the FECJENG disk, if no other user is on the PROJMNG disk, 
the disk is activated in the read/write sode. The main 
computer executes the disk's profile routine. PROFILE EXEC 
is performed whenever the disk is accessed in the write 
capatle sode. This exec has been uniguely tailored for this 
FROJHNG specific disk (see Appendix E ). It reads up tc six 
class x files queued to the disk. First the PROFILE EXEC 
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sets the disk reader file to look for class x, "SPOOL RIR Ci 
x", +$.and then reads the files, “READ *", The progras has 
been designed to reset the reader spool to spool any class. 
Upon cosfletion:cf writing files onto the disk, the command 
"SPOOL RCR CL **® returns normal spooling capability 

The PROFILE read function would nominally expect to 
find a set of files, DATAFILE TEAMxx and DATACODE TEAMxx. 
The read limit was expanded frem two files to six, fcr three 
fairs, in expectaticn that there will be occasions when the 
disk will remain in use by cther teams. When other teams are 
still using the disk the autolog will be unable to perform 
its one shot access to the disk. SMSG will not remain queued 
to access the disk. In order to read those class x files 
that may have been left waiting, subsequent running of the 
FROFIIE EXEC will read in several more files than those 
transmitted in the ctrrent PROJMNG session. The exec will 
read up to three additional pairs. 

The benefit in using the class x spooling capability 
is the cue which this class gives. It tells the disk that 
the file is a PROJMNG file. Normai spooling usage within the 
IBM 3033 does not use x. 'X* has a uniqueness within the IBM 
system and will reduce the possibility of PROJMNG EXEC 
reading non-PROJMNG files. 

The files are not read onto the PROJMNG disk while 
cther users remain or the disk. Attempts to write onto the 
disk in this situaticn result in garbling the data files. 


Ce. ODATAEASE SECURITY 


The first query the team answers in PROJMNG is to 
provide the team nunter. _ 

The second guesticn asks for the team to create a tean 
security code. The team may enter any code of up to eight 
characters. If the eight characters are all zerecs or 
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contain ncthing (nulls) the program will again ask the tean 
to change the code. PROJMNG begins succeeding sessions by 
asking tke team to match the security code stored in data 
kasd, the team's security code. 

The security code system gives the team access tc its 
€atabkase while assuring that data has not been altered by 
anyone except the teas or the monitor. This has benefits to 
the team and to the siaulation. The team doesn't have to 
worry about data being changed accidently and the monitor 
has less concern that the team's work might be compromised. 
The security code is also used for proposal submissicn. [Lue 
to its length and issrobability of being entered correctly 
ky mistake, the security code performs the functicn of 
assuring the monitor of the team's intent to subsit the 
fropesal as indicated. 

The monitor can change the database to correct errcrs in 
the team files. Cerrections may become necessary if the 
team submits a report and then wants to change it. The 
proposed and final data reports for a DP are not accessitle 
by the teas. Lack cf access to submitted reports increases 
team ccrpitment to the report. It also, provides the 
gaonitor with a fixed team position reference point. This is 
critical if the monitor is to create a contractor fosition 
by which to interact with the tean. 

The subaission cf reforts and their purpose are 
discussed in greater detail later in this chapter. 


C. EXIT 


In P&CJMNG several methods of stopping the program have been 
Frovided. These are: 

1. Fatal errors 

2. Security violation 

3. Menu option 
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4. Yes/No query 
1. Fatal Errors 


The computer capability to stop the program when a 
programmed statement cannot be performed (executed) is 
referred to as a fatal error. PROJMNG has selectively snodi- 
fied the fatal error response. 

The program termination in response toa null entry 
(pressing the <<ENTER>> key without providing a character 
including the character blank * ‘') was unsatisfactory. 
Inadvertent null resfonses repeatedly dumped users cut of 
the prograg. 

fo resolve the fatal error dump (stopping the 
program), a GIOBAL routine (program which can be called 
from the IBM 3033's resident routine files) is called. The 
"CALL ERRSET* enables the program to ignore fatal errors and 
proceed with the progran. When PROJMNG finds an error 
during the frocess of reading information from the terminal, 
it performs a jump to the statement specified as the error 
default by the READ statement. Very serious errors in 
syntax will continue to be dumped by the computer. 

Failure to answer PROJMNG's questions satisfactorily 
will cause it to relcop to either the same question cr to 
call out the EXITS routine. If an error is serious encugh, 
the EXITS routine will be called. EXITS allows termination 
of the program, or if the team wants to continue, EXITS will 
return to the top of the last query routine and allow the 
prograg to reloop. Correct entry of the security code will 
give the team access to the main proyram and existing data 
files with that team's number. 
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2. Security YViglation 
Turing the start of a session at the terminal, the 


user will te queried for his previously entered security. 


code. The program will permit the user to answer the 
security code query incorrectly only five times during the 
course cf a DMS exercise. At occurrences of incorrect 


security code entries, a count is kept. On the fifth ccca- 
sion when the code is entered incorrectly, the counter will 
tell the program to stop. Successive attempts to enter a 
tean file whose security file counter has reached five will 
terminate at the security code query. 


3. Mepu 
A standard oftion in the main menu of FRCJMNG is 
EXIT. Selecting the EXIT option directs the prograz to 
stop. Again, this cperation returns computer executica to 
the FRCJBENG EXEC progran. Completion of the PROJMNG EXEC 
run will return contrcl to the LINKPROJ routine which fres- 
ents the guery for ancther run. 


4. YES/NO Query 


Each query in PROJMNG which can be answered with a Y 
for YES or N for NC, can also be answered with an €£ for 
EXIT. this E response either calls the program subroutine 
EXITS oc stops the frograa. EXITS gracefully steps. the 
program ky permitting either return of the computer's ofera- 
tion to PRCJMNG EXEC or by relooping into the last query 


routine. 
5. Beturn to PRCJMNG EXEC 


The terminaticn of PROJMNG FORTRAN returns the 
computer execution to PROJMNG EXEC. This routine executes a 
transmittal of all team files to the PROJMNG disk. 
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OFF", Termination cf the record permits the team to either 
“. name and save the session's record on disk, to edit it, to 
print it, to quit it ("Q") which places it on the disk 


< 
ss Nts 
x Bee Ew PRCJPENG PROCEDURES 
Us 1. Jastructions 
at) 
a The procedures used with PROJMNG FCRTRAN are signif- 
a icantly different frcm CNP. Appendix F contains the PRCJMNG 
: Student Instructions. These iastructions replicate the 
ee program's screen displays. Appendix F demonstrates a 
ke: session using PRCJMNG. Checks and corrective procedures in 
S% PROJMNNG render the making of errors more difficult. 
. However, some examples are demonstrated in the PRCJMNG 
i Student Instruction's tutorial. 
2 2. Link 
2 The instructions ask the team to access PRCJMNG 
nS solely by executing the command LINKPROJ. This command runs 
oo the program LINKPROJ EXEC. LINKPROJ EXEC is a routine waich 
eS a creates the disk link and accesses PROJMNG as the user's '‘C! 
: Ty disk, as discussed above. This exec must be placed on the 
, team disk. From there it is able to link and access 
oe FROJMNG's disk for the team. 
eS Among the cafabilities of LINKPROJ are the defini- 
- tion of programmable key PF39. This function can be executed 
os by pressing <<ALT>> and <<PF9>> simultaneously. 
5 LINKPROJ also executes a pair of calls to the macro 
NS computer program routine "RECORD". The first of this pair 
s enables the recording of all session terminal activity. The 
Z latter executes after the session has been completed; it 
x terminates the record of the session. Teams should be aware 
- that if the progras dumps or they exit the program without 
ri performing the "RECCRD OFF", the record will continve in 
ne effect. It can be closed by inputting the command "RECCRD 
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spool, cr to purge tke record. Addition of this capability 
permits review of team session. Undetected difficulties or 
errors that result ir program malfunction can be reviewed. 

In crder to facilitate rerunning of LINKPRCJ, the 
routine does query whether the team wishes to run "“ANCTHER 
RUN, Y/N". This feature is one which LINKPROJ holds in 
common with the other programs in the PROJMNG package of 
routines. PROJMNG is designed to allow the team tc termi- 
nate or reloop through program execution. 

The running of PROJMNG FORTRAN does not occur fron 
LINKPRCJ. LINKPROJ runs limited functions already speci- 
fied, and calls the FROJMNG disk's program PROJMNG EXEC. 


3. EFROJMNG EXEC Execution 


PROJMNG EXEC serves several functions in preparing 


the tean disk for the session. 
a. Team Disk Status 


The PROJMNG EXEC routine provides several 
queries to the team disk. Through the response error return 
codes it receives indication of the availability cf tean 
data tase files and security code files. The purposes 
accomplished by this frocedure are: 

(1). File Availability. The error return codes 
tell ERCJMNG EXEC wtether there are files available for use. 
Neither FROJMNG EXEC nor PRCJUNG FORTRAN can proceed withcut 
files frcem which data can be read or to which data can be 


written. 


(2)- Fide Integrity. Having found a_ usatle 
DATAFILE on the team disk, FRCJMNG EXEC attempts to read the 
contents. It looks efecifically for the team number. The 
team numter cues PRCJMNG EXEC not only as to what the tean 
should ke called, it also reveals the prior use of the 
CLATAFILE tc store data. 


ee wae a a eT Te tL LO BL. bag er ont oS Be we ii inn, hee . eee ta eee oe ee ve 


fe rk. Monitor File 
In a similar manner, PROJMNG EXEC determines the 
availability and validity of the monitor file "DATAINST 
DISKNOM". The presence of data in the file and the security 
field format within CATAINST DISKNUM tells PROUJMNG if the 
disk gaining access to it belongs to a monitor. Cisks 


belonging tec monitors are not intended to ke the disk which 
students access to run PROJMNG. 


Ce DATAFILE Creation 


PROJMNG EXEC determines the team disk status. 
If DATAFILE and CATACCDE files are not found, PROJMNG EXEC 
proceeds to determine the tean number. It will ask "WHAT IS 
YOUR TEA NOMBER?" tefore it copies the files. After the 
teap numter is evaluated for being in the range of 1 to 20, 
the program generates the "TEAMxx" label. It will accept 1 
to 20 with any number of preceding 0's. The TEAMxx latel 


- 
”, 


ae 
will include up to fcur numbers in the xx field. This latel 
is used in the process of copying the dummy files. PRCJMNG 
copies the dummy files using the labels DATAFILE TEAAxx and 
DATACCDE TEAMxx as the new file name and file type. 

In the event that more than 20 team files are 
required, FROJMNG will accept team file labels with addi- 
tional leading zeroes. Teams with files labeled TEAMO1 and 
TEAMOQ1 can both be created. 

The availability of the DATAFILES also gives 
FROJMNG EXEC the teaa number. Lack of DATAFILES is synony- 
mous with no team number. The team nuaber is detersined 
cnly once during the course of the gameplay. It is PRCJMYNG 
EXEC that makes that query. It forms the team numkter into 

Bs the "xx" portion of the files’ type labels. PROJMNG stacks 
a the team number intc its virtual reader to enable PRCJMNG 
on FORTRAN to copy the team number. PROJMNG PORTRAN uses the 
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team numter to label displays and, when storing the data- 


base, flaces the numfer at the head of the record. It is 
this storing process and filling in of the first DATAFILE 
field which later enables PROJMNG EXEC to find the tean 
number withcut additicnal queries. 


4. Eunning EROJNNG 


EFRCUMNG EXEC completes determining if the disk 
kelongs to a team or tecnitor, gets the team number or sets 
the mcnitcr's flag of team number 21 (FL21), insures the 
availability of write files or creates them, and then loads 
and starts FROJMNG FCRTRAN's text file. The teaa database 
capability has teen set for 20 teams. The data file for 
monitors was chosen in excess of the team database design 
size of 20. Having chosen TEAM21 to be the monitor's file 
label, it was convenient to utilize the label TEAM21 asa 
flag between PROJMNG EXEC and PROJMNG FORTRAN. It indicates 
to EFRCJENG FORTRAN that the computer operator for the 
sessicn has been determined by PROJMNG EXEC to be a gonitor. 
Upon termination of PROJMNG FORTRAN, PROJMNG EXEC again 
takes contrel. If the operator is a monitor, the EXEC 
allows tte monitor to request the creation of a concatenated 
file of allcurrent team files on the PROJMNG disk. For 
team disks, the exec sends a copy of the files DATAFILE and 
CATACCDE to the master disk. This file transaissicn enables 
the scnitor to detergine team progress and to accept the DP 
decision rerforts. PECJMNG erases unnecessary residual files 
such as the LOAD MAF and then returns execution control to 
LINKFECJ to perform the “ANOTHER KON, Y/N?" query. The 
team's response to this question will either terminat the 
sessicn or reloop the program to the beginning of LINKPROJ. 
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Fo UDATAEASE CHANGE 


After data files have teen created, PROJMNG uses the 
CATAFILES as a baseline of team information. Once the file 
is created the program assumes the data is accurate and 
Satisfactory for use in all subseguent sessions. All 
further Selection Menu displays will display the OMS data 
items as they are currently found in the team's file 
DATAFILE TEAMxx. 

At the beginning of the team's first session all of 
their data items must be submitted. A database is generated 
from which successive sessions will obtain their baseline of 
inforration. The process of asking for all data items 
occurs through the prcgram's subroutine PAGEIN. 

The rages of the PMS decision sheets, Appendix BE, list 
the data entries necessary for CNP. These same entries are 
gueried once in PEOJMNG by PAGEIN as demonstrated in 
Appendix F. Each fage of data queried coincides with the 
fage and the data item of the decision sheets. Availatle 
parameter ranges are listed with the item name in PAGEIN. 
Correct completion of a page of data permits the program to 
check the data input for errors. If the prograw does not 
understand the ingut, or requires revision, a 
SteeeHARNING**#*** is displayed and questions designed to 
correct the discrepancy are asked. If the data entered 
cannot be read by PECJMNG the EXIT query "DO YOU WISH TO 
CONTINUE: Y/N?" will occur. Teams experiencing confusion, 
or wishing to exit tte program during PAGEIN, can do so by 
pressing <<ENTER>> without any input. During PAGEIN this 
action will enable the team to use the exit query to stop 
the progras. 

The autcaatic call to the PAGEIN routine occurs only 
when the DATAFILE contains 0's in all of the data base data 
fields. Successive sessions in PROJMNG by a team utilize 
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Po os the datakase DATAFILE to fulfil the data field input func- 
{ tion. PAGEIN can be called at any time from the Selection 
y Menu. This option permits the team to make mass changes to 
Ma) 

data iteass. 
a Once the program has a set of data it will produce a 

table ccntaining those values, Table IV. The SELECTICN MENU 

> gives a review cf the current data values and acts asa 
+. selection menu for iteszs_ the team wishes to change. 
3 SELECTICN MENU presentation is achieved by either corpletion 
g of PAGEIN, ty beginning a subsequent session, by coapletion 
oH of a DP proposal subsission, or by team choice from the MAIN 
~ 
BS MENU. 
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ayy 
AS 

her 
wy YCU WISH TO: 
aS Cae, 
a tS 

a 

Pigure 3.1 MAIN MENU. 

‘| 
we 

oe G. MENU 
ea 
a Centinuing seguentially through an initial terminal 
at session with PROJMNG, the next feature which differentiates 
a this frograr from CNF is the MAIN MENU, Figure 3.1. From 


this routine inthe main progran, any of the opticns 
performed ky PRCJMNG for the team can be executed. This 
menu places the PROJMSNG FORTRAN program in the category of 
being a menu-driven frogram. 
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TABLE IV 
DATABASE PRINTOUT as SELECTION MENU 
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The cptions available in the MAIN MENU are to print the 
table of achieved values, to return to the database table, 
to sukpit a proposal, or to exit. ; 

The achieved values option directs the prograp to 
execute the routines associated with creating the 
Development Contract Summary table, Table V. First the data 
entries for fee percentages are checked. The fee rercent- 
ages are added together and evaluated to determine if they 
total 15%. If they donot equal 15%, PROJMNG FCRTRAN 
requests corrections through a seguence which displays each 
current fee percentage value and asks for a value to be 
submitted. The program performs the computations for the 
table created in sutroutine FROSUM. Then the table is 
displayed. Each tise the computations are made the run is 
counted. After ten runs, the program adds a fee of $100,000 
onto the contract price for each subsequent run at that DP 
level. 

The seccnd option returns the display of the data table. 
It provides the team with the table, Selection Menu, of data 
iteas which are used for reference in changing data values. 

The third capability from the MAIN MENU is’ frofosal 
submissicna. Subgission of proposals is discussed in the 
next section. 

To enakle the team to stop the program, the fcurth 
option in MAIN MENU allows ther to exit. 


HB. S8EPOST SUBAISSION 


1. Egeggess Reperts 
Subgission of progress reports has been readily 
accomplished in PROJMSNG EXEC. The process of completing 


FROJMNG EXEC when leaving PROJMNG FORTRAN serves to execute 
the ccamands for file transzission as discussed 
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in subsection 3.5.4.2. The process of data file trarsmis- 
sion to the PROJMNG disk provides those files for access by 
the gecnitor. In the sonitor's session, all team data files 
which have been sent to the PRCIMNG disk are copied onto the 
monitor's personal disk for read/write use. This feature 
was also discussed in 3.5.5. and is covered in greater 
detail in Chapter 4 with the discussion of monitor 
functions. 


2- Decision Subsission 


Submission of the team's decision occurs with the 
transmittal of the team files to the PROJMNG disk. Within 
the data fields transmitted, there is a label field which 
contains the status of the team's work on a given decision 
point. This field is either btlank, "00000000", ““PROPCSED" 
or "FINAL". These labels are sequentially exclusive. They 
specify the exact status for the DP level of the set of 
database fields in which they are contained. Each DF level 
tas four lines of data in the DATAPILE TEAMxx. The DP 
status label is the last field of data in a set of lines. 

The DP field labels are assigned in the FINISH 
subroutize. By accepting the values in the table of 
Froposed values for the contract proposal, Proposed Values 
Table (Table WI), or of praposed final values as the final 
approved contract, Final Contract Values Table (Table VII), 
the téam causes the label to be written. These labels cccur 
only when the team enters its security code to validate the 
Froposed values. Cospletion of the value assignments to the 
database for transmittal aprears with the table of accepted 
values, Table VIII . 

The label is written as tae last field in each cf DP 
level database records. These labels can be seen in the 33rd 
field of each set of four lines of a DP data, Table Ix. 
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TABLE VI 
Proposed Values Table 
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TABLE VII 
Final Contract Values Table 
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TABLE VIII 
Accepted Values Table 
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Use of the security code in this feature was 
designed for ‘human factor’ engineering. The conscicus 
process cf entering the team's security code indicates the 
user’s déeliterate entry of the data. Inadvertent accertance 
of the datakase for the team's position cannot occur. 

The team does retain the responsibility for reading 
and understanding the data displayed in the table of data, 
Nable VII. 

| The process of the team submitting a final contract 
Froposal frovides the program with the position agreed to 
during contract negotiations. Submission of the final 
report indicates to the program that tne team has conpleted 
a DP level. PROJMNG assumes the team is ready to prceceed to 
the next DE level, for example DP-4. It utilizes the 
previous CP level data entries from the submitted final 
report and prepares the new DP data table. The team is 
sequenced tc the next higher level whenever a final prorosal 
is detected for a given DP level. 


Ie CALCULATION CORRECTION 


As discussed in Chapter 2 several of the computaticns 
which were designed for CNP to accomplish were not satisfac- 
tory. Consequently tteir display was suppressed. 

In PROJMNG these calculations have been reforsulated. 
Their algoritha is Fased on the linear extrapolation of a 
fee over the range of its alloted parameter values. the 
contract cost for the fee incentive is calculated by: 


1. Assume achieving optimum performance results in total 
ro fee payment. 
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mee 2. Assuse achieving the worst performance expected 
wh results in no fee payment. 
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3. Determine the ratio of satisfactory achievement; tie 


difference between the achieved value and the worst 
value expected divided by the range of value retween 
werst and optigun values expected. 

4, Multiply the ratio determined by the maximum fee 
percentage offered for the incentive. 

5. Multiply the resulting percentage by the target 
development ccst, the average value of the mpaxinua 
and ginimum desired develofnent cost. 


The following equation is used in PROJMNG to determine 
fee ratio. 


FEERATIO=FEEMAX* (aks (WORSTI-ACHIEVED) ) / (RANGE) (egn 3.1) 


This formulation for fee costs has proven tc ke mcre 
satisfactory than that of CNP. 

The difficulty in CNP arises from numerical mnanifula- 
tion. Farameters in CNP frequently have their power-ci-ten 
changed to permit calculations at different resource mgu:ti- 
ples. This is particularly true in the case of achieved 
develorment cost. Frequent multiplication by 1,000,000 with 
division ky 1,000,000 to return the dollar values to 
millicns of dollars incurs computer roundoff. The roundcff 
errors when repeated several times become sufficiently large 
to be apparent in the ratio calculations. 

PROJSNG does not use the numbers which the computer used 
in computing achieved value resources to determine the fee 
values. Its numbers are taken directly from the database 
array, and are only mathematically manipulated by this cne 
calculation. This process results in only one iteraticn of 


roundcff error. 
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PROJMNG is not able to eliminate computer rcunicff 


error, but the rcundoff effect has been significantly 
reduced. 


J. SUAMARY 


PROJMNG's design has its foundation in CNP's routines which 
were designed arcund (MS. it uses this foundation from CNP, 
and develors an extended program. The program extension uses 
the current IBM-3033 facilities to drive user-directed 
options in a manner which provides the team contrcl over 
Frogram execution for completion of the DMS exercise. ‘These 
features for team use of PRCUJMNG make PROJMNG easier tc use 
in anacyzing team positions. Chapter 4 discusses the anal- 
ysis capabilities of PROJMNG which are available to the 


monitcr. 
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IV. PEQJSNG MONITOR O 


RATION 


A. CBE MCNITOR UNIQUE FUNCTIONS 


CNP has one routine capable of providing support tc the 
Bonitcr for his evaluations of the scenario progress. This 
singular routine is nct available to the teams. The monitor 
can access the COST + FACTORS Table, Table X as discussed in 
the previous charter. Access to the monitor routine cccurs 
ty the ccmputer operator's resrfonse to the guery for "CCST + 
FACTORS ?". This response is coded to provide security of 
the COST + FACTORS table from team access. In ocrder to 
preserve its integrity, the security code will not ke given 
er demonstrated here. Correct security code responses to 
koth the first "COST + FACTORS ?" and a second query of 
"COST + FACTORS ?" are necessary. The first response is a 
three character code word. The second guery resronse is 
based on a data field used in the computations which has 
already teen entered for the session. It constitutes a 
variakle security code. 

In CRB, an additional mecnitor capability is frovided 
through the confirmation query, "CONFIRM ?", at the DP 
number verification sequence, "Is THIS DP NUMBER ** 
XX;"Y"=YES CR "“NY=NC 7? , Response to this query witha 
fixed single letter, places the operator in the "INSTRUCTCR" 
mode. Analysis cf the program's Fortran code indicates that 
the INSTRUCTOR mode simply suppresses the queries for 
confirmation and the repeat back display of input data. 
Answering the statements "IS THIS DP NUMBER ** xx 3"Y"=YES OR 
“NR=NC 28 with a "I" reduces the displayed queries. it 
eliminates the repeated displays of "RECEIVED ......3 XXXXX; 
CONFIRM ?". It also eliminates the repeat back printout of 
input page data. 
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ae have nct fcund benefit in these options. Additional experi- 
ee ence with CNP is necessary to use these features success- 
fully. Consequently, use of the "T" feature has not been 
used. The COST + FACTOKS table has been found to te less 
than adeguate. 
i Bo FRCJENG MONITOR ONIQUE FUNCTIONS 
on In PROJMNG a variety of options are available for the 
yee moniter. They include: 
eae, 1. Menitor Unique Security System 
ee 2. Query Suprpressicn for the Monitor 
aye 3. Menitor's MAIN SENU 
Sey 4. File Access Oftions 
“5 5. CCST ¢ FACTORS 
oo 6. Sensitivity Analysis 
Pannen! 7. Graphing 
oe ae 8. Ccepies of Student Files 
‘ ™ Cr This chapter will review the intended capability and 
aoe operation of these mcnitor unigue functions. 
‘en 
ae C. HCHIIOR UNIQUE SECURITY SYSTEM 
’ 
ae The PRCJMNG EXEC routine looks through the ccmeuter 
Boe operator's disk for a file titled "DATAINST DISKNUM". 
Pale Having lecated this file, the computer assumes that the 
ee cperatcr is a monitor, and proceeds to validate the monitor 
a identity. The program contains three file checks to deter- 
<2) nine if the operator is a monitor. Unsuccessful coapletion 
Sore] of the first two checks will cause the computer tc ignore 
ty) the DATAINST DISKNUM file and assume the computer user is a 
ee student. 
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Re oes The first of these checks is the file format. The file 
U. . first line must contain the userid. The second line atst 
ne contain a moniter specified security code. This monitor 
a security code is queried in the same manner in which the 
Ne team security code is queried for a team disk. 

- The third verification is a check of the stored monitor 
ae security code against the individual's ability to reprcduce 
“ that code. A code match allows the program to proceed. 
fe Failure to accurately match the code causes the fregram to 
= stop. PROJMNG EXEC takes control to finish its executicn. 
Ee The user can reaccess PROJMNG FORTRAN in his response to 


“ANOTEER RUN, ‘Y'/*N® 2%, 
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BD. QUERY SUPPRESSION FOR THE MONITOR 
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mt 

fo Successfully accessing the program as a pcnitor 
5% 

By Suppresses the student's Main Menu, discussed in chapter 3. 
we 


Conséguently, the scnitor does not receive the student's 
Main Menu after each alteration of the Selection Menu. 
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Rt: Based on the assumption that the computer operatcr is a 
ts Monitcr the program inmediately follows the Selection Menu 
NSS with the Development Contract Summary, Table XI. 

‘ Table XI demonstrates the display sequence for _ the 
ey Selection Menu with the execution of option "0". The soni~ 
es tor's response to the Selection Menu with a zero causes the 
wr immediate execution of the achieved value calculations. 

: Cther selections from this table are performed sinilarly to 
% those done for the team. The changes entered by the monitor 
Oe) in this first node will not be stored in the database by the 
ms programs. In gsonitor gode 1, the call to the routine STCRE 
rei does not occur. Only the array of data in the disk's buffer 
ae will be altered. The sonitor sees the computer response to 
ae his entry of a "0" as an immediate display of the 
= Develcrpment Contract Summary. 
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ER. MCHITOR'S MAIN MENU 
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The PRCJUMNG monitor's MAIN MENU contains options to 
allow the monitor access to any of the routines in the 
Frograa. It has a unigue feature in its flexible length. 
This feature provides menu listings to the monitor which are 
determined ty his status in the program. If the monitor has 
just entered PROJMNG or has changed the team number, and has 
not ccmpleted the cogrutaticns for other display values, the 
Frograr® will suppress those cptions from the menu disglay. 
Options which reguire calculations or selections which have 
not been processed for the team are assumed tc present 
results which are either not applicable or misleading. 


MAIN MENU: 
1. CHANGE TEAM NOMBER 
2. TEE DP SELECTION QUERY 
3. THE INPUT SELECTION MENU 
a 4. RERUN THE DATA CALCULATION 
ws 5. DO_A SENSITIVITY ANALYSIS 
Ty] g- PRINTOUT COST+FACTORS 


Figure 4.1 Monitor’s Main Menu. 


Figure 4.1, demonstrates the basic monitor's Main Menu. 


1. Change Team Number 


Cption 1 when selected will return the aonitcr to 
the program's team input routine (TEAMIN). The execution of 
this routine begins ty displaying a menu, Figure 4.2. The 
selecticns on this menu are: 
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ao 
) ae 
ES ~ 
{ FCI WEICH INSTRUCTOR MODE YOU DESIRE. 
as RUN TEAM SCENARIOS WHICH ARE ON THE MONITOR'S DISK. 
$s CHANGE TEAM FILES. 
- TBIS MCDE WILL ALTER THE STUDENT'S FILES. 
os RUN TEE MONITOR'S TEAM FILE 'TEAM21*. 
a EXIT 
Fy 
ne 
ws Figure 4.2 Monitor Mode Menu. 
Ay 
‘ a. Run Team Scenarios from the PROJMNG Disk 
fs 
i Selecting this choice enables the monitcr tc run 
e. 
nf evaluaticns and displays of the teams whose DATAFILEs have 
‘ been written on the PEOJMNG disk. PROJMNG has at this joint 
a already written these files to the individual monitor's disk 
y for use. As the acnitor selects a tean to review, the 
=f Frogram determines if the team file exists. If the file 
.7 e exists, the monitor say proceed with the evaluation. If no 
‘wl files exist for the team requested, PROJMNG responds with 
A "FILES DC NCT EXIST FCR TEAMxx', and proceeds to ask for a 
a different team number, ‘WHAT TEAM NUMBER ?", until a team 
my number is submitted for which files are present. 
- This opticn selects a node of operation in which 
be team data files are not changed by the monitor. The senus 
ro displayed are only those associated with the recnitor's 
a 
we cpticnas. The Monitor's Main Menus are flexible menus. The 
oe discussion of this flexibility and of the basic menu will be 
“+ 
re, provided in the follcwing sections of this chapter. These 
, 
a differences are dercnstrated by the two monitor menu 
ae 


displays fer mode 1, Figure 4.3, and for mode 2, Figure 4.4 
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avy “AY MAIN MENT: 
1. CHANGE TEAM NUMSBER 

* 2. THE DE SELECTICN CUERY 

3. THE INPUT SELECTION MENU 

4 4. RERUN THE DATA CALCULATION 

af 5. DO_A SENSITIVITY ANALYSIS 

=n) 6. PRINICUT COST#¢FACTORS 

t) 7. EXIT 
ei 
wes Pigure 4.3 MAIN MENU in Mode 1. 
va | 
% ee se ne eee ee ea | 
a 
iy MAIN MENU: 
Hs! 1. CHANGE TEAM NUMBER 

2- THE CLF SELECTION puree 

‘ 3. THE INPUT SELECTION MENO 

4 4. RERUN THE DATA CALCULATION 
i 5. DO A SENSITIVITY ANALYSIS 

a g ERINICUT COST#FACTORS 
= e FILE TEAM PROECSAL 

res : - EXIT 
re tts 
oe Figure 4.4 MAIN MENU in Mode 2. 
rsd 
Ks 

tk. Change Team Files 

ad 
a Option 2 has an entirely different affect on the 
* database. Again, the files accessed are those previously in 
4 
a existence. The monitcr receives a different version of the 
im MAIN SENU, The added option in this nenu, "7. FILE TEAM 
Ka PROPOSAL" permits the monitor to change the DP report level 
Es. for any cf the team's DPs irregardless of the team's current 
OW level. 
3 The monitcr can perform all of the functions he 


ES could in mode 1 plus changing the report level and placing 
; these selections in the team database. This mode should only 
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te used to correct team errors. Team database manipulation 
cote for any cther reason will Lead to team confusion. 

The query which finalizes the replacement of the 
team database, “SHOULD THE REWSITTEN TEAM xx FILE 8E SENT TO 
THE ERCJENG disk: Y/N 2". Unless this query is answered in 
the affirmative, the zode 2 capability to overwrite the tean 
file is not performed. 

Answering yes to the guery to rewrite the tean 
file directs PROJMNG through a routine which performs three 
calls to the subroutine FRICMS which permits CMS executive 
level commands to be executed from within a Fortran program. 
The three ccmmands in this routine are the same as the spool 
commands in PROJMNG EXEC which send the file DATAFILE TEAMxx 
to the PBOJMNG disk. The disk punch file is spooled as a 
class x file. The DATAFILE TEASxx is punched into the sfocl. 
Finally the spool is closed and sent to the PROJMNG disk. 

The program does allow the DATAFILEs on the 

sess moniter's personal disk to be rewritten whenever mode 2 
Cy operation is selected. Transsgission of these files tc the 
master PROJMNG disk can be accomplished after respondirg in 
the negative to the query "SHOULD THE REWRITTEN TEAM xx FILE 
BE SENT 10 THE PROJMBG disk: Y/N ?". Sending these files to 
the master disk must bea deliberate act of the acnitcr. 
The menitor may either use one of the macro routines in 
general usage on the IBM-3033 for sending files between 
users, “SENI". Or, he may spool the files for immediate read 
Ey the FROJMNG file using the following sequence of sters. 


ats ( The lower case characters in the following command dencn- 
be a 2 2 2 

in stration are optional inputs. ) 

oe 

ae 1. “"SEocl PUNCh CCNT CLass X 0276P" 


dam 2- “EUNcCh DATAFILE TEAM (XX)", where xx is the two digit 
team nuaber. 
3. "EPocl PUNch CLOSE NCCCNT" 
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In mode 1 or amcde 2 operation, only the 
Cevelogpment Contract Summary tabie resembles the same 
display for the teams. 


ce. Run the monitor's tean file "TEAM21" 


The third opticn provides a team file for the 
monitor. TEAM21 is the monitor's own team file to simulate 
the team interaction with the program. This provides a 
scratch pad file for the monitcr's use. 


qd. EXIT 


' Option 4 from the ponitor's Main Menu stops the 
program. Entering a "4" in response to this menu directs the 
program te stop. PROJMGN EXEC resumes control of the 
computer precessing. 


2. Zhe DP Selection Query 


Number 2 on the monitor's mode menu reloops the 
program to the DP query for which DP the monitor desires to 
evaluate. This query will not prevent the monitor from 
accessing DE levels for which the teams have not submitted 
files. the level which the team has completed is displayed 
on the Selection Menu, with the DP query, and on the 
proposed rerort table. This information should be known by 
the monitor based on the progress of the DMS scenario. 


3. The Input Selection Menu 


Again, the menu routine simply reloops the prcgranm 
executicn to a previously executed question to permit the 
monitor to change his sode of analysis. In this case he 
returns to the team Selection Menu. The last team and DP 
inputs entered during the monitor's session will apply to 
the team database which is disrflayed. 
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Charges to a team's list of data in tne prcegjgran 
Euffer which have teen entered during a session renain 
applicable until the team number is changed. Any variaticns 
to the Selection Menu which have been'selected for the tean 
currently being evaluated will be in effect. In mode one, a 
tean's data will revert to the PROJMNG disk's team datafile 
values when changing team numbers. Mode 2 will keer the 
changed values until the PROJMNG disk values are reccpied 
down cnto the monitor's disk. 


4. Rerun the Data Caiculation 


This option causes PROJMNG to redo the achieved 
value calculavions. The display for this selection isa 
repeat of the Develorgment Cost Summary. 


5. Lo a Sensitivity Analysis 


This option creates a major option for exploration 
ee ty the nenitor. It is discussed as part of the sequential | 
er demonstraticn of the monitor functions which follows in | 

Secticn I below. 


6. Exintout Cost + Factors 


Sigilar to the capability for COST + FACTORS dencn- 
strated Ly CNP, PRCJMNG has an equivalent feature for the 
monitcr. Table XII shows the improved layout of the data. 


2 
Pa 


The table has the benefit over CNP's version by not 


i“ 


requiring a separate code to access it. The table is simply 


a 
a af 


Lia 


accessed as a menu sé€lection from the nonitor's Main Menu. 
7. EXT 


This is anotker example of PROJMNG'sS ability to stop 
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the program. 
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TABLE XII 
COST. FACTORS 


CCSTS OF TESTS PEK UNIT (IN THOUSANDS OF DOLLARS) 


CUALIFICATION TESTS | 
MOTOR : 32.034 
AIR FRAME ; 126.355 
GUIDANCE ; 309.906 
FIRE CONTROL ; 25 6-198 
LAUNCHER 3; 424.555 
FLIGHT TESTS : 316.855 | 
DESIGN FACTORS ACHIEVED 
CCMPONENT TABLE k&OW FACTOR ACHIEVED | 
MOTOR 3 1 745) 0.825 0.877 
AIR FRAME : 2 15 0.958 0.980 
GUIDANCE A ; 5 22 0.666 0.630 
GUIDANCE B : 6 25 0.580 0.90 
FIRE CONTROL 3; 4 16 0.845 0.802 
LAUNCHER 3; 3 7 0. 936 0.988 
IHCOOQ1A EFAUSE ;PRESS <<ENTER>> TO CONTINUE. 


8. Flexible Menu 


The options fresented in this section are the tasic 
capaltilities of PROJMNG. However, additional capatilities 
become yrossible as the evaluation progresses. With the 
completicn of the sensitivity analysis additional takles and 
graphs are within the capability of PROJMNG. These flexitle 
menu capabilities are explained and demonstrated in Section 
I of this chapter. 


Po SCHIIOR SESSION FROCEDURES 


The remainder cf the discussion on menus will be 
Fresented sequentially in the following sections. Their 
relative position in the textual sequence corresronds to 
their cccurrence in the process of stepping through the 
Frogram's routines. 


ap a ae Fe 


ve These sequential steps of PROJMNG are demonstrated as 
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the program would be operated. The material in this dencn- 
stration is preliminary to the preparation of an instruc- 
tor's manual. The sections are: 


1. Initialization 

2. Basic routines of the Main Menu 
3. Sensitivity analysis 

4%. Logoff unique routines 


Ge. IBITIALIZATION 


The monitor's access to the PROJMNG package of 
programs is also acccmplished by LINKPROJ. The determination 
that the disk accessing PROJMNG is a monitor is made, as 
discussed in Chapter 3. Having completed the checks of the 

Poa moniter's file DATAINST DISKNUM, the PROJMNG EXEC progran 

ws conducts a check of files for a DATAFILE TEAM21. This file 
wust ke present on the monitor's disk if he is going tc use 
it in PROJENG. PRCJMNG EXEC either finds the file or 
creates cne in order to have the file ready for PRCJMNG 
FORTRAN*s read and write instructions. 


2. Available Piles 


The lack of fresence of the files which PROJMNG EXEC 
looks for is an autcmatic function of the IBM-3033. This 
capability was retained to display to the monitor a list of 
teams frem which he has not received reports, as shown in 
Figure 4.5 Offsetting of the display from the left margin 
was perfcrgzed in order to highlight between the computer 


Frintout and the typed queries. 
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A benefit of the "PRESS <<ENTER>>" set of statemerts 
is the akility to tegin a display ona fresh screen. 
Displays which shovld appear as one screen occur acre 
readily when the pause has finished the previous display to 
keep it displayed while the user is reading it. The fause 
can te followed by an immediate command in FRTC¥S to 
"CLRSCEN ', clear the screen. This sequence of ccmnards 
leaves a fresh screen for the next screen display. The 
first line that PROJMNG prints out appears as the tcf lize 
of a display (see Pigure 4.7). 

Cueing the user to fress <<ENTER>> identifies a 
fause which has beer placed in order to organize screen 
displays. The pause in Figure 4.5 enables the display of the 
teams "not found to te isolated on one display. There caa 
ke up to 21 teams displayed, as for example at the start of 
an exercise scenario. Without the pause to segregate the 
displays, all 21 teams would not appear on one screen. the 
Single screen full of one type of data aids in user ability 
to study and analyze the data. Splitting the display tca 
second view eliminates the first screen's data and taxes the 
user's recall to do any ccmparisons. Isolating the data 
onto one screen eliginates these jiisruptions to tke user's 
study of the data. This technigue of segregating relatei 
informaticn onto a screen has been used throughout this 
program. 


3. Eurging DATAFILEs 


In order to frovide a convenient method of purjing 


re files trem the completed exercises, a routine was generated 
Hay which permits the scnitor to purge all of the existing 
wa files, to conduct ncrmal operation of the prograg cr to 
oe exit. These options are depicted in the display as shown ia 
ta Figure 4.6. The purge option purges only the available ‘a' 
re disk DATAFILE TEAMxx and DATACODE TEAMxx. Shouid the 
OF uate 

SS 
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7 vay BEGIN RECORDING OF TERMINAL SESSION 

li * NOTE!: YOU ARE NCW LINKED TO PAROJMNG 

ie ON YOUR 192 DISK, MODE C | 
— * NOTE!: PRESS PFCS TO BREAK THE LINK 

me : PRESS <<ENTER>> WHEN YOU ARE READY TO CONTINUE. 

a *9O444,....EXECUTICN IS IN FROGRESS. 

; WAIT. DO NOT PRESS ENTER. ##*##4#*# 

wet FILE "DATAFILE TEAM21 A* NCT FOUND. 

“4. FILE "CATAFILE TEAM11 C* NCI FOUND. 

es FILE "DATAFILE TEAM12 C* NCT FOUND. 

- FIIE "*LCATAFILE TEAMI3 C* NCT FOUND. 

tt FIIE "CATAFILE TEAM14 C* NCI FOUND. 

e, FILE "CPATAFILE TEAM15 C* NCI FOUND. 

mt FIIE *DCATAFILE TEAM16 C* NCT FOUND. 

q FILE ‘DATAFILE TEA..17 C* NCI FCUND. 

: FILE "DATAFILE TEAM18 C* NCI FOUND. | 

FILE *DATAFILE TEAM19 C* NCT FOUND. 
FILE "DATAFILE TEAM20 C* NCT FOUND. 

ae = oa 
oe Figure 4.5 Initial Monitor Display. 

oh Fon FROJMNG EXEC purge function te performed on the PRCJMNG 
rf Ue” FORTRAN‘s disk the entire exercise scenario would be elini- 
ae nated. Cnly database files pre-existing on team files or 
on monitcr's files could be reaccessed for PROJMNG. With a new 
am play of the exercise, it is expected tnat a new group of 

' teams will be accessing PROJMNG. No conflict with ferzer 
mss team datakases should be experienced once the monitor's and 
a the PRCJMNG's disks have been purged. 

on Normal operation initiates PROJMNG FORTRAN execu- 
Co tion. Ihe standard procedure during a game exercise is 
a designed to respond to this query with an "Nf", The word 
aN length difference between FURGE and WN has been designed to 
ts make inadvertent destruction of the team files more 

~4 

e difficult. 
ed "E" again provides a means of stopping the rfregram. 
re In this instance, "“E" will stop PROJMNG EXEC and return the 
me computer to running the LINKPROJ program. The final display 
oe itd) 
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of LINKPROJ, "ANOTHER RUN, "Y¥* OR 'N*'?", would be the query 
following the request to stcp. 

"WAIT FOR EXECUTION 10 BEGIN" became a necessary 
printcut as the result of long waits for execution to tegin 
on the NPS IBM-3033. (One monitor reported experiencing a 
20 minute delay during very heavy use of the conmguter 
facility, with the "WAIT FOR EXECUTION..." label reminding 
him that the program was in the queue to be run.) 


SCEKKEY ARNING £444 4% 

*#4*4 ANSWERING ‘PURGES TO THE FOLLOWING RUERY WILL *# 444% 
*#*e*PURGE ALL EXISTING STUDENT DATAFILES* ***4* 
**#**%40ON THE DISK YOU ARE USING. ##*4#* 

DC YOU WISH TO INITIALIZE ALL TEAM FILES 
FCR A NEW CMS EXERCISE? 

*PURGE* =PURGE ALI TEAM DATAFILES 
‘N*'=PROCEED WITH NORMAL OPERATION 
"E*=STOF 

2===>p 


WAIT FCR “EXECUTION TO BEGIN". 
EXECUTICN BEGINS... 


Figure 4.6 Mcnitor Session File Purge Option. 


These initial queries, printouts and displays by 
PROJMNG in the monitcr mode of operation should appear to 
the reader as very sizilar to those presented to the teams. 
It should also ke rcticed in Figure 4.7 that the prcegranm 
does not ask for a téam security code input to create the 
team's cede. Instead, it has already received the mcnitor‘'s 
security code from FROJMNG EXEC. The monitor's code is 
found by PRCJMNG FORTRAN in DATAINST DISKNUM. 


fH. EASIC PROGRAMS ROUTINES 


The rogram routines discussed in this section perforn 
similar frocesses in EFoth CNP and PROJMNG. 
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1. Start of PROJMNG's Run 


The stacked data items are read by PROJMNG as its 
first step in the routine for team number input "TEAMIN". 


Ret wee ee ROGET a Ing SHE PECCRKe Le ay core 


TO TERMINATE THE PRCGRAM AT ANY POINT, 
T WE"SEXTT IN RESPCNSE TO ANY "YZS/NOW” Y. 
EKAAAPSESAHRKKKEKCKESKSEKSESKEK EKAEKKEREKEKEKKKEKAEEKE rTereT tT 
*S4CAUTICN#*SIN RESPONSE TO A QUERY, PRESSING <<ENTER>> 


WITHOUT PROVICLING DATA WILL DUMP THE PROGRAM 
A AESSSE SER EER ESSE TERE OEE EEE EEEE EH HEE EE BEE EEE EEE OOD 


LEASE ENTER YOUR SECURITY CODE. 


Figure 4.7  PROJMEG Initial Dis aays- 
Raving received the FL21 flag of TEAM21, and vali- 


dated the monitor's security code, PROJMNG can proceed. IF 
the security code shculd be entered incorrectly, the PRCJMNG 
executicn is terminated. The monitor receives a warning of 
the error, and is asked to reinitiate his startup of the 
program. He may either answer ‘Y¥' to "ANOTHER RUN, ‘Y* OR 
'N¢ 2?" or reenter "LINKPROJ" after PROJMNG EXEC and LINKP&EOJ 
EXEC have finished execution. 

FROJUMNG FORTRAN asks for the team number when a 
moniter is running the progras. Team selection withir the 
programs is necessary in order to permit the evaluaticn of 
More than one team. @hereas a team will only enter the 
program with one teas scenario to perfora, the monitcr is 
able to change teams without reinitiating the prograg. 

Figure 4.8 demonstrates tke response given by 
FROJMNG when it cannot find files for the team numter 
reguested in either options 1o0r 2 of the monitor's Main 
Menu. The read cue '?' indicates to the operator that an 


ae 


yi 


0 ell all el lt eee, 


input is expected. In the operations demonstrated throughcut 
this thesis '====>' indicates the user input in response to 
the FRCJFNNG queries. Figure 4.8 also presents a case in 
which tke program does find the requested fiies and proceeds 
to query the sonitcr for which DP level he desires to 
evaluate. 


nEM TEAM NUMBER? 


RECORDS DO NOT EXIST FOR TEAM 2 
WHAT TEAM NUMBER? 


3 
i DECISICN POINT DO YOU WISH TO ANALYZE? 


Figure 4.8 Team Number Responses. 
The queries illustrated in Figure 4.8 complete the 


functions cf the program routine TEAMIN. The program returns 
to the main program text and enters the SELECT routine which 
displays the Selecticn Menu as it did for the teams, tatle 
XIII. Table XIII functions the same as before except that 
the entries are not stored in the team's database file. the 
changes are made orly to the monitor's disk data Luffer 
arrays. In option 2 of the monitor's main menu, the changes 
are also stored on the monitor's copy of the teas files in 
his file listing. These changes are not applied tc the 
PROJMNG disk files urless the nsonitor specifically sends the 
changed files to that disk. 

In response to option ‘0 in Table XIII PRCJMNG 
immediately coapletes the calculation of fee percentages in 
the program routine FRCTCK. Successful completion of the 
percentage check is followed with the calculaticn of 
achieved values. This process occurs with the program calls 
to the rcutines: 
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TABLE XIII 
Selection Menu 
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ZEW - sets all non-database variables used in the 
ccafutations tc zero. 

INPUT3 - reads the data tables in files fFI17F001, 
FI18FO01, FT1SFO001 and FT20F001 ; 

PRESET ~ uses the database values to make initial 
adjustments tc the achieved value indices 

TRADE - evaluates the team's input tradeoffs and uses 
them to generate affects which to apply in calcu- 
lating the achieved value indices 

DESEES = degrades the performance factors kLased on 
reguests for system test. 

DESRET - degrades the performance for the effects of 
selected engineering values and performs the calcula- 
tions for production costs. (This feature, preduc- 
tion cost coamfutation, was not used in CNP and has 
not keen activated in PROJMNG. ) 

SE - applies resource parameters to the achieved 
value calculations. 

.4CD9 - combines the calculation results from the 
previous three routines to derive a total cost factor 
fcr develcpment. 

RERUN - selectively sets recursive variables to zero 
to enable the frogram to finish the calculaticns of 
one DP and to reloop to compute the values for 
successive DP*s 

REPOBT - completes the calculations after all Dp 
level comrputaticns have been completed. 

P5CSUOM = performs conversion of the achieved values 
to the appropriate power of ten for display tc the 
user and generates the display, Table XIV. 
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2. Summary of Basic Capabilities 


To this point, the kasic capabilities of PRCJMNG 
which it has in comucn with CNP have been discussed. The 
improved displays, access and queries discussed farallel 
those features given to the students, with exception of 
student access to COST + FACTORS. In the next section, the 
*flexitle menu' feattre of the monitor's main menu, and the 
associated capabilities for sensitivity analysis, for data 
displays, and for analysis graphing are described. 


Ie SENSITIVITY ANALYSIS ROGTINES 


1. Sensitivity Analysis Basic Menu Options 


Figure 4.9 shcws again the monitor's menu in mcde 1 
operaticn fcr comparison to the expanded menu which is now 
descrited. In order to accosplish the calculaticn cf a 
sensitivity analysis, option 5 from the menu is selected. 
In performing this selection, a flag is set ‘on' to indicate 
the availability of values for use in the other displays of 
the €xpanded menu opticns. 


MAIN MENU 

1. CHANGE TEAM NUMBER 

2- THE DP SELECTION sures 

3. THE INPUT SELECTION MENU 
4. REBUN THE DATA CALCULATION 
5- DOA SENSITIVITY ANALYSIS 
§- ES TatOUs COST+#FACTORS 


Figure 4.9 Monitor's Sain Menu. 
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Selection of number S$ from the menu imnediately 
accesses the programs routine SNSITIV. This sucroutine 
provides a selection genu (Table XV), queries parameters and 
parameter data for variation inthe analysis, edits the 
parameter data ‘to remain within DMS scenario limitations, 
divides the variable parameter into 10 steps for 11 levels 
of evaluation, runs eleven cycles through the achieved 
values calculations, displays the table of achieved values 
at each level, and stores these values in an array fcr later 
use in redisplaying the table and for plotting the computa- 
tions. | 

Fellowing the display of Table XV, the monitor makes 
a selection of which [MS data item to analyze. His selection 
determines a series cf questions which PROJMNG displays in 
order to resolve the analysis parameter details. Figure 4.10 
shows cne of thesSe gueries. In this case the Flight Tests 
will ke varied. The maxinum and minimum values permitted 
are displayed with the queries for range values. These are 
not cnly cues to the user but also are the limitations which 
FROJMNG imposes. 

If the selection exceeds the scenario design linits, 
FROJMNG will take one of two actions. In the first case, 
FROJMNG will reset the value to be within the range 


Y FLIGHT TESTS BETWEEN. 
2 >10. ? 


} 
WHAT IS THE UPPER VALUE: <25. ? 


=222>75 


Pigure 4.10 Flight Tests Deaonstration. 
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TABLE XV 
Sensitivity Analysis Menu 


NON ES 44% €4% 


NG COST 
cost 


< ia 
ICD RI peGIeathe] ni rdie 
BVA NMnqae 


KE ITEM WHICH IS TO BE SENSITIVITY ANALYZED. *##** 


Ne 
BBAAIWMAGSZMOwass 
1838s IO CL) Cano 
«g be @Omus emmy 
Hw eae 
SPO mBMMIOOk whl 
etd OS OS 6 OS Eos 


At eOHdHOSOOM SH 
BS Sed Ste 


awa een oe eee ee wee Oe eee eee ee ee Oe eee = eer eet errr eee 


eoreoeneveseree 
FAM PNK DHNOEN 
ree 


Se448S ELECT 1 


¢ 


oy qd 


‘A 
OG, 
» 

Ae 


‘¢ 


° 


re 


SN aN 
Pee re ee mat 


Ae See a hl et ed De ed ee a ae 


permitted. If the second case occurs, the user will be 
ve requeried fcr input. This occurs when PROJMNG doesn't under- 


vee 
WAS 
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stand the limits requested. 
2. Sensitivity Analysis Table 


The Sensitivity Table, Table XVI provides a siaple 
column display of the achieved values computed at each step 
of the analysis as a function of the related parameters. The 
steps are labeled in the lefthand column. The second cclumn 
lists the value of the selected parameter for the step. 
Some of the parameters will result in duplicate stegfs. 
FROJMNG divides the range of the parameter values by 10 
which can result in a fraction. In creating a step for the 
table, the parameter value can be successively rounded to 
the same value. PECUMNG is telling the monitor, it has 
recognized the parameter as requiring an integer value. It 
has provided the closest integer to the value. The duplica- 

a tion is the occurrence of the closest integer as the same 

we number on successive cccasions. The first occasion PRCJMNG 
rounded up to the value and on the second occasion it reunds 
down. 

The remaining columns, except ZI, are self explana- 
tory. They correlate with the achieved values data given in 
the takle of Developmsent Contract Summary, Table XIV. EI is 
explained later in this section. 

Upcn completicn of the table, PROJMNG displays the 
cue of "IHCOO1A PAUSE ;PRESS <<ENTER>> TO CONTINUE". This 
holds the display for review by the monitor and reminds the 
moniter of the action to perfcrm arter reviewing the tatle. 


3. Sepu Expansica 


EFressing <<ENIER>> causes the program to ccntinue. 
The sequential routing of PROJMNG returns the monitor's MAIN 
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MENU display in the main program. Figure 4.11 lJemonstrates 


the flexible menu with the new options. These options are 
discussed as we proceed further into PROJMNG. 


SAIN MENU: 

1. CHANGE TEAM NUMBER 

2- TEE DP SELECTION queEt | 
3. TEE INPOT SELECTICN MENU 

4. RERUN THE LATA CALCULATION 

5. DC A SENSITIVITY ANALYSIS 

6. ERINTOUT CCST+FACTORS 

7. PRINT LAST SENSITIVITY TABLE. 

8. ELOT LAST SENSITIVITY ANALYSIS ACHIEVED VALUES. 
9. PIOT LAST SENSITIVITY ANALYSIS FEE PERCENTAGES. 
Q. EFLOT WITH SELECTED Y-AXIS SCALES. 

1. USE OPTIMUM E E FROM LAST SENSTIVI 

ANALYSIS FCR CATA. 
2- EXIT 
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Figure 4.11 Monitor's Main Menu in Mode 1. 


Numker 7 on the menu returns to the last display of 
the Sensitivity Table viewed. PROJMNG's subroutine SNSITIV 
is reentered through acall (entry) at the end of the 
subroutize, ENTRY SNSPET (enter SNSITIV and print the 
table). SNSITIV's array of stored values enables PRCJMNG to 
reprint the table without any calculations. 


4. Sensitivity Apalysis Plottiag 


The second new feature available through the nain 
wenu is the capability to graph the table results. The 
stored values in the array are fpassed to the PLTSCH sutrou- 
tine in a data buffer, COMMCN EFLOTVA. The graph is 720 lines 
high and fills the entire screen. Conseguently a fause 
statengent at the bottcm of the graph could not appear on the 
same ecreen with the display. 
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THCOOIA PAUSE 3; PRESS << ENTER>> TO CONTINUE. 
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In crder to alleviate this difficulty tae sauce .ae 
been eliminated. The display appears on one Screen wits tue 


ct 
. 
cr 


addition of a blank line which forces the I&4 to soci: 
display under the condition of a screen overficw, as inii- 
cated by the "MCRE" in the screen lower right corner. the 
screen can be held only tempcrarily in this I8M #iisplay 
mode. If the operatcr desires to extend the hold fer closer 
analysis of the graph, pressing <<ENTER>> will change the 
IBM display mode to "HOLDING" which can remain indefinitely. 
Once tte operator has finished with the "MORE" dis;:lay sode, 
or the “HCLDING" mcde he can continue Fy ciearing the 
screen. Cn the IBM 2278 this is accomplished Ey yressirg 
<<ALTD> and <<CLEAR>> simultaneously. 

The definiticn key for characters is displayei on 
the graph, as given in Figure 4.12. A series cf frint 
statements has been flace in FLTSCH to iist the key in the 
Tighthand graph margin. 


ee eee —s 
e = DEVELOFMENT COST | 
T = FLIGHT TEST COMPLETICN DATZ 
f = RELIABILITY 
@ = ACCURACY 
& = TCTAL FEE EFERCENTAGE | 
$ = TCTAL COST | 
* = EFFECTIVENESS INDEX { 
& = Several curves intersect | 

I 


Figure 4.12 Flot Character Key Definitions. 


The table displayed by "8. PLOT LAST SENSITIVITY 
ANALYSIS ACHIEVED VALUES." divides the screen teijgnt of 
twenty lines into the largest value which is tc be 
displayed. This functions as the ordinate scale for the 
graph, Figure 4.13. PLTSCH displays tae entire set cr data. 
In the next selectior, "9. ELCT LAST SENSITIVITY ANALYSIS 
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FEE FERCENTAGES." the vertical axis is provided with a 
scale of 0.5 per line. The height of the ordinate recozes 


10, which will display the fees up to 10%. The benefit of 
this charge in scales is in the presentation of a magnified 
view in the y-axis ketween the range of 0 and 10 where the 
fee percentages are concentrated. Figure 4.14 demonstrates 
the percentage graph. 

Graphing can also be scaled by the monitor. Checsing 

Sensitivity Menu opticn number 10 directs PROJMNG to ask for 
the ranges which are to be used for the y-axis. Figure 4.15 
demonstrates the interactive exchange between the prcgram 
and user to create the desired y-scale. The program accepts 
any values for the adinimum and maximua values for the axis. 
The progragz again divides this range into 20 steps. The step 
size kecemes the y-axis scale. If the scale is less than 
0.05 rer line, PROJMNG resets the scale to 0.05. Figure 
4.16 demonstrates the graph resulting from the steps in 
figure 4.15. 


MAI’ BENU: | 
1. CHANGE TEAM NOMEER 
2. THE DP SELECTICN goeet 
3e THE INPUT SELECTION MENU 
4. REFUN THE DATA CALCULATICN 
S- DO A SENSIILVITY ANALYSIS 
6. ERINTICUT COST+ FACTORS 
7. PRINT LAST SENSITIVITY TABLE. 
8. ELICT LAST SENSITIVITY ANALYSIS ACHIEVED VALUES. 
9. PLOT LAST SENSITIVITY ANALYSIS FEE PERCENTAGES. 
10. FLOT WITH SELECTED Y-AXIS SCALES. 
11. USE OPTIMUM EI VALUE FRCM LAST SENSTIVITY 
13 a FOR LF-3 DATA. 
Ze 


Figure 4.15 Nonitor's Main Menu in Mode 1. 
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5. ffectiveness Index 


Selection 11 on the Sensitivity Menu provides the 
wonitor with a means of directly copying into the data array 
(Selection Menu) the best sensitivity parameter value for 
the highest EI value. SNSITIV determines the best occurrence 
of the highest value of Effectiveness Index. The EI with 
the lcwest parameter value is used for cost analysis, accu- 
racy analysis, and ccupleticn date analysis. For parameters 
involving ‘reliability’, the EI of the highest farazeter 
value is stcred in EICPT. It will not make a change of the 
optimum selection stcred in those cases where the mininun 
value is zero. It stores the sensitivity parameter's step 
number in variable EICPT. When option 11 is selected, the 
sensitivity parameter being evaluated has its value changed 
to that of the evaluation step which had been saved in 
EIOPT. Figure 4.17 demonstrates the revised Selecticn Menu. 


6. Flexible Yenu Reset 


Sheuld the mcnitor change the team, the DP level or 
the data irthe datatase the calculations made by SNSITIV 
are no longer applicable. FROJMNG ‘flags the use of the 
subroutines which generate these changes. Through the 
running cf these sukroutines, the ‘flag which expands the 
Sensitivity Menu is reset to ‘off'. The option tc replot 
graphs or tables based on the frevious set of data is 
invalidated. 

Selection of the mode 2 option to "FILE TEAM 
FROPOSAL" generates the monitor node flag MR. For mode 2, 
MR=2. "his flag causes the zenu statement to file the 
froposal, and flags the program when leaving mode 2 either 


at exit cr on return to the Monitor's Mode 4Yenu to ask if 
the rewritten file should be sent to the PROJMNG disk. 
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J. SUMMARY 


The FROJMNG FORTRAN program retains its basic comfuta- 
tions and organizaticn in ccmmon with the origiral CNP 
Frogram. These basic features have been enhanced by improved 
user/frogram interaction, and by the reformulaticn of the 
achieved value fee percentage computation algoritha. 

FRCJMNG FORTRAN has an additional benefit over CNP in 
the extended sensitivity analysis capability it provides to 
the mcnitor. Both the sensitivity tables and graphs enhance 
the monitor's ability to evaluate the team's progress when 
using PRCJMNG. 
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VY. SUMMARY AND CONCLUSIONS 


A. SUSMABY 


The DMS exercise provides a time proven aeans of 
educating project managers in the potentials, sensitivities 
and incertives of acquisition management. This same cafa~ 
bility is the significance of CNP and of PROJMNG as training 
aids in the DMS exercise. The support of project management 
training Ey computer programs has existed for the past 
twenty years. This thesis has upgraded the availaktle 
computer program suprort for DMS. PROJMNG provides DMS with 
a user-friendly interactive tool to assist in the aquisition 
Banagenent training rrocess. 


B. OD8&8S 


DMS has proven to be an effective training exercise. It 
provides personnel in the Department of Defense, and 
personnel in other system acquisition environments, with 
relevant maragement training. 


1. Benefit 


The benefit of DMS as a training exercise is ir the 
requirement it places on students to understand acquisition 
Managegent concerts. It provides a seyguenced set of events 
to develop, produce and deploy a missile The Decision 
Point's serve as planning nilestones that the student teams 
must prepare for in order to successfully manage their 
acquisiticn project. Their understandiag of the concepts of 
acquisition management is challenged by the exercise ina 
pseudo-real time scerario. 
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2. Computer Support 


Turing the twenty years in which DMS has been avail- 
able, tkere has been a revolution in the tools available to 
Support prceject management. The ability of computers to 
rapidly crganize, process and correlate data has changed the 
acquisition management environment. 


3. CNP 


DMS has adapted somewhat to management evoluticn Ly 
its incorporation and development of CNP. 

CNE is an interactive Fortran program which has been 
used for the past decade. In its current configuraticno, it 
is difficult to use. Since it is not user friendly. 


C. FROJENG 


In crder for DMS to remain a relevant management 
training exercise, it must be kept current in its state-cf- 
the~art fanagement ccncepts, trainiag facility, and computer 
support. The Fortran program PROJMNG has been created to 
provide DMS a program which is more aser-friendly. It is 
not just an off-shoot of CNP. It incorporates porticns of 
CNP cy virtue of utilizing most of the subroutines and algo- 
cithms of CNP. PROJMNG improves the Fortran support for [MS 
in its refinement of CNP and by expanding the prcegrammed 
suppcrt for analysis. 


1. Eenefits 
ERFCUMNG's benefits include: 


e program access 
e program exit 

e session record 

e data file of input parameters 
e menus for operation selection 
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e expanded sensitivity analysis 


e tables and graphs te study parameter sensitivity 
e user-friendly displays 
® monitor-téan communication interaction 

through datafile exchange 


2. Shortcomings 


FROJUMNG has not been completely validated. Its 
achieved values have not been tested sufriciently to deter- 
mine its akility to react in a pseudo-realistic manner to 
parameter variations. 

Additionally, the programming facilities utilized in 
PROJMNG are not as modern as they could be. The PRCJMNG 
capability has been hampered by the limitations of the 
IBs-3033. Areas in which these limitations have impacted 
PROJMNG are discussed in Chapter 6, Recommendations. 


3. Eirst Usage 


FRCJMNG has undergone a field test. It was used to 
support the Winter 1984 course in Project Managenent, 
AS-3501, taught at the Naval Postgraduate School by Icdr. J. 
Ferris. This field test resulted in the following prograa 
enhancenents: 


e Ability tc mass purge data files 
e Ability cf the monitor to send files to the 
EFROJENG disk 
e The SMSG autolog feature operates only when 
no users are accessed to the PROJMNG disk 
® All displays are formatted for 80 character 
wide personal computer (PC) display. 
* All exec guery resfonses are tested for input errors. 
e PROJMNG EXEC tests files for format before 
replacing the team disk copy. The file used 
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for the team database is sequentially the 
first one which exhibits the correct format 
from either the PROJMNG disk or the tean, 
and defaults to the file "FILE DATAFILE". 


During this field test, the major problem in facilitating 
the prograg occurred in the autolog procedure. The SMSG 
automatic log-on of the PROJMNG disk occurred regardless of 
users being on the disk. This situation resulted in files 
keing read into the disk without proper organization. The 
files sukjected to this garbling were unusable. 

SMSG is now frogrammed to write the team files onto 
the FECJMNG disk only when the disk is not accessed by any 
user. 


The wide usage of D4¥S in the U.S. and other coun- 
tries provided interest in making PROJMNG capable of use on 
various computer systens. CMS unigue features and IBM 
extentions to fortran have teen discussed in this thesis to 
enable adaptation. In its present form PROJMNG relies 
heavily on CMS and its executive language facilities to 
Manipulate the data files outside of the Portran prcgran 
envircnment. These facilities require assessment on a case 
Ey case basis in order for FROJMNG to be usable on any 
system other than IBM's CMS with the FRICMS extention. 


a. FORTRAN 


The program has been compiled both cn _ the 
FORTRAN H and FORTEAN GI compilers of ths NPS IE¥4-3033. 
FROJMNG is unable to compile in WATFIV (WATERLOO FCRTRAN). 
The ccerplication which precludes the WATFIV compilaticn is 
the call to PRICMS. It is desirable to not remove the FRTCMS 
calls. They provide a major enhancement to the pregram by 
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enabling the program to clear tne screen, ‘CLESCHN *. iLcss 


cr this feature would disorganize the PROJMNG displays. 


T. COCUMENTATION 
1. CNP 


A major proklem in working with a program is its 
documentaticn. CNP has several styles of documentaticna. 
There are periodic lines of text to label or explain the 
programs oferation. These comments were beneficial in 
reconstructing seme cf the program operation, but inadequate 
in deciptering the prcgram operation. 

The best documentation present in CNP were the names 
selected for variables. Each of the input variables, a 
majority of the cosputaticnal variables andthe rcutine 
Names were carefully selected to provide a relaticn with 
their data definiticn or with the process they represent. 
The variables in most of CNFE are acronyms. 


2. ERCIMNG 


EROJMNG contains additional comments throughout the 
Frogram code taken frem CNP. Frequent comments have been 
added to explain the processes accomplished by groups of 
code and routines. All of the terms added to the program by 
FROJMNG are meaningful acronyms for the routires and 
variatles. 


3- Glossary 


Appendix H provides a glossary of the terms used in 
both CNP and PROJMNG. Compilation of the glossary provides a 
documentation method which suprlements the benefit cbtaired 
from selecting varialtles which are acronyms for the content 
definiticn. Some definitions for CNP terms in the glossary 
remain urdetermined. 
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4. Bebugging 


Terms used in a program without adeguate documenta- 
‘tion may interact in unexpected areas of the prograr. With 
3063 variables in the program, CNP is a maze of connections 
between variables. Tracking the details of terms used in CNP 
was difficult. The two worst aspects of terms in CNF are 
multiple definitions for aterm and aanipulation of the 
variaktles tc change the value's power-or-ten multiple. For 
example, RATIO is used in CNP to determine the percentage of 
a fee to te awarded, it is aiso used as a value of riilicas 
cf dcllars paid for fees, and it is used in a resource ratio 


calculation. An example of the manipulation of variables is 
the array C1IC(8). This array is used in nillions cf dollars 
and in dcllars. 
The disadvantage in using mixed definitions fora 
variable is the impact which occurs on calculaticns which 
at depend on the variatle. If a calculation is based cn a 
(e specific multiple of the variable and it has’ varying values 
dependent on which sutroutine used it last, the programmer 
cannot utilize the variable. He must consider the inability 
to predict the occurrence of changes to the variables 
definitica. 
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oy VI. RECOMMENDATIONS FOR FUTURE CONSIDERATICN 

ae The planning, design and execution of this revisicr to 

C™, CNP have generated the following recomtendations. 

eo e Increase the program Support to the exercise 

a e Expand the program to support more Decision ?cints 

bres in the DMS exercise 

ar ® Yevelor a DMS ccmputer assisted titoriai 

ms e Validate the achieved values 

A ¢ Change the data tables to formulas 

ce e Increase the sensitivity analysis capabilities 

an e Improve the graphics resolution 

Pa e Change the tenu displays to ‘platet displays 

on e Develop a program to create project management 

on fake exercise scenarios for actual system acguisiticrs 

( ts" e Use PRCJMNG to encompass other CNP program variaticns 

2 

os 

: Ae INCREASED EXERCISE SUPPORT 

me 1. Discussion 

R= The wide availability of personal computers frovides 

oe project managers and students with improved data prcecessing 

es capability. They new have computation capability availatle 
to them instantaneously throughcut the acquisiticn precess 

as for storing and analyzing their own specific acquisition 

ss data. If DMS is to continue to provide project managers 

oe with training at the level now availaple in the management 

~ environment, it must have scftware facility equivalert to at 

SS least that cf their rfersonal systems. It is feasible to aake 

- the DMS program compatible with PCs. DMS must be supperted 
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at the state-of-the-art. It must be contemporary in 
providing a pregras which has the degree of comrfuter 
facility which the managers experience in day-to-day use and 
in actual acquisition planning. As this capability 
develors, the program supporting DMS should expand to: 


e Support all DMS Decision Point levels 
e Interface with student and manager PCs 
e Support actual acquisition scenarios 


2. Regccumendaticn 


Design new program capabilities to permit DMS adaptation for 
broader application to PC's and to change the acquisition 
Management frocess. 


Be IMNCLODE ALL DECISICN POINTS 
1. Liscussicn 


Both CNP and PROJMNG support the DNS exercise only 
for DCEF-3 and DP-4. The present DMS scenario includes six 
Decisicn Pcints. All of the DP's require team analysis of 
the exercise parameters and submission of Decision Sheets 
(see Appendix 5B). These characteristics are conducive to 
incorporation of these DP*s into other PROJMNG like 
analyses. 

Use of an interactive computer program to support 
Ce*s 1 and 2 would frovide an opportunity for each team to 


do a Fetter analysis in these early Decision Points, and to 
initiate the team database for later use. Inclusion of all 
DP*s in the program would permit documentation of the entire 
team exercise perforsgsance in one computer record. 
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2- Reccapendaticn 
A future computer support program for DMS should be 


designed tc expand exercise support from the PROJMNG and CNP 
capability cf DP 3 and 4 evaluation to all exercise DP's. 


C. DEVELOP A DAS TUTCRIAL 
5 1. Eiscussion 
Computer tutcrials have become a popular methcd of 
= training. The availability cf computer assets for CNP or 
aM FROJMNG indicates the presence of computer hardware to 
“3 support a tutorial frograa. Student interaction with a 
cosputer supported DSS tutorial could be used to intrcduce 
: the student to the DSS exercise, to perfc._. saaple protless, 
4 and to give examples. 
# the one-on-one capability for student reponse tca 
ey. s CMS tutorial should te limited to exercise orientaticn and 
yy fasiliarization. DE's 2 through 6 provide an opportunity 
re ‘for a team-work experience. This team interaction should 
s remain ar integral part of the DMS exercise. 
» 

4 


2. Resommendaticn 
‘aa Incorporate the DES training scenario into an acqui- 
sition sanagezent' tutorial. The tutorial is seen as 
froviding: 


e scenario presentation to the individual 

e review of initial rositions 

e aid to students to remedy difficulty 
with concepts 
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De. VALILATE PROJANG 


‘oe 1. Discussion 
a 
3s Correlation of achieved values between the 
24 CNP/ERCJMNG programs andthe DHS data values has not been 
degzonstrated. An analysis should be conducted in order to 
os determine if the algorithas in PROJMNG provide realistic 
§ approxisgaticns to the full DMS batch prograa. 
of Evidence exists of differences between some CNE and 
7 PROJMNG results. Eitker program may be at fault. PRCJMNG's 
oral errors result from its acceptance of the algorithms and 
ie calculations contained in the original CNP prograa. the 
St values ccmputed by CNP can not be assuzed to be accurate. 


Current classroom usage of PROJMNG has been fredi- | 
cated on the assuapticn that these values indeed perfora as | 
should be expected. This assuaption was based on the inccr- 
poration of the Fortran code for the achieved values calcu- 
laticn from CNP into EFROJMEG. 


2. Reccamendatics 


an A series of evaluations should be conducted to 


compare the actual CSS batch outputs and with the rerfora- 
ance cf PRCJMNG. 


ba Z. REPLACE THE DATA TABLES SITH EQUATIONS 
] 1. Discussion 
eae 
po The tables of values included in CNP/PROJMNG have 
ae) 
ee limited range in which performance data can be oktained. 
al Beyond these limits data values are not available for calcu- 
ne lations. In sost cases, CNP does not warn the user that he 
Se has performed a calculation which is not a feasible solu- 
ats tion. In most cases, PROJMNG forces the team to resubsit 
a data itens which are outside the range capatilities 

Bo. 
Y : “Spr oN 
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Ee) discussed in the DMS instructions. There are parameters for 

“Ne which lizits are not specified in the DMS handouts, and 
which can result in unusual calculations such as achieving a 
flight test completicn date of 0. 

There are twe reascns for redesigning the progran 
resource value algorithms which are used to calculate 
achieved values. Pirst is to provide a continuous function 
instead of a step function. The table values read for 
calculations in both CNP and PROJMNG do not provide contin- 
uous value functions. Second the values have a lisited 

= range. Student selections which are beyond the capability of 
ie the table result in erroneous achieved values, such as the 
i flight test exaaple atove. 
The results provided by CNP and PROJMIG, as 
‘ discussed in Chapter 1, are not actual results. They repre- 
a sent apprcximate results to reflect the real world issue of 
contract risk. 

NS The progragging of equations to obtain the resource 
7 eo walues will result in the need to validate the achieved 
$ values predictions. Validating the values achieved asa 
“i result of changing the resource allocation algoritha would 
a ke of equal complexity to validating PROJMNG's current 
results. Both walidatien projects vould verify the 
program's capability to produce realistic predicted contract 
performance values. In the interest of reducing the expen- 
o- diture of effort between these two validations, the effort 
would te best applied in one project. To validate FPRCJSNG 
MN and later require revalidation for a new algoritha would 
ws" obviate the former. 


ta 2. Recommendation 
i First, redesign and implement the equaticns for 


determining resource allocations. Second, validate the 
eh entire new program package of PROJMNG for DMS support. 
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ab F. INCREASE SENSITIVITY ANALYSIS OPTIONS 

i 1. [discussion 

cae ) 

a the optiohs available in the sensitivity analysis 

tt menu do not have as dramatic an effect in deszonstrating the 
impact of incentives and other parameters as had been origi-~ 

oe nally expected. Sensitivity curves showing definite freaks or 

en valleys in the achieved effectiveness index are not demcn- 

ey strated as readily as had been anticipated. The graphic 

presentation and sensitivity selection options should be 

we designed tc provide the user with a clear depicticn cf the 

Me effect of ircentive variation. The user should te able to 

al readily determine from the sensitivity analysis products the 

- benefits or disadvantages of changing his decision above or 

oe below his current position. 

63] 

) oe Determine other analysis options which say have 
“es greater value to the sonitors. Conduct a series of analyses 
s to deterzine if they affect the sensitivity, and to eliszi- 
ah nate those options which do not cause an achieved value 


fluctuation. 


Ge ISPRCVED GRAPHICS 


1. Discussion 


Cne area of computer. hardware and software develop- 
ment which is rapidly changing is graphics. The graph 
subroutine in PROJMNG was specifically designed for the 
-: program and has a nuater of lisitations. No other IBs-3033 
graphing frograa was found which provides multiple curve 
Me gtaphing, selectable scales and the number of variaticns 
ve which EFRCJNNG provides. A (continuous) curve plot is needed 
, to enhance demonstration of parameter variations. The 


& 
‘ 100 


cnr see eee ARE SOE PRP IRM ANNE ne ie Ad Dy ae eT CC REC n Cts 


Faw b8 ahd rs 


pee tae 


PAS 


‘ 
2. 
Phy 
t ty 
iy 
‘y 


i 


ree 


RES 
> 


graphic detail which is needed to improve the dispflay dces 
not aprear to be within the capability of the IBM-3278 
terminals which are currently a widely available coarfuter 
peripheral for student use, and which are particularly 
available in large quantities at NPS. what is needed is the 
ability to control screen display for continuous line flots. 
This type of resolaticn for the graphics on the IBM-3033 is 
not within the IBa-3278 terminals capability. Terrinals do 
exist which provide greater screen control and which can be 
progrargued to plot ccntinuous lines for the IBM. 

Display detail is undergoing evolution. The advan- 
tages of color for highlighting presentations adds a percep- 
tible benefit in human ability to comprehend. Color can be 
used to add a percepticn of relative weight of significance 
tetween curves and tetween points on a curve.The use of 
characters and figure presentations which exceed the stan- 
dard typewriter characters in ASCII presentations increase 
the pictorial communication of data., Both of these factors 
“color graphics and detailed display pixle control- are 
receiving widespread attention in interactive computer 
systess and shculd be considered as enhancements for 
Computer support prcgramgs which will be successors tc CNP 
and PROJANG. 

A tenefit to plotting continuous curves is the 
ability to separate rcints of curve intersection. Ancther 
benefit is the ability of continuous curves to show the 
connecticn tetween fecints in the sasze curve. The PROJENG 
Flots readily demonstrate the difficulty in presenting the 
different curves whose plots have a coinciding point. 

In the short tera, use of Fortran capable disflays 
on the Tektronix 618 or the Ramtek does not appear reascn- 
able. Seweral factcrs degrade the significance of izple- 
menting cperation on a more ccaplex graphic systema. One is 
the added processing time and cost for a display. the 
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second reason to not consider graphing the program cn a 
graphics display system is the rapid rate of technical 
develorrent currently occurring. Based on the presence of 
new ITEM coler graphics terminals at NPS, the facility at the 
We R. Church Cosputer Center may be expected to provide high 
resoluticn color graphics for users in the not to distant 
future. In this case the effort to recode the PRCJMNG 
Frogram fer high resclution graphics on the Tektronix or the 
Raatek graphics terminals would be obviated both in ccmuyara- 
tive cost and in utility. 

Another factcr which should be considered befcre 
programsing DMS suppert on a graphics unigue system, such as 
CISSFI1A, is whether the system will allow DMS tc remain 
transportable. CNP and PROJMNG were designed to be cost- 
effective ty their potentially wide distribution and usage. 
The ccugscn availability of the systems on which these two 
programs are based permits them to be widely copied. Use of 
unigue display systems would reduce the tranportability and 
preclude spreading the cost over a wider user population. 


2. Reccapendaticn 


Future computer progrags to support DMS should 
degonstrate aulti-colcr plotting capability and continuous 
line graphing. 


He PLATE DISPLAYS 


1. £discussion 


The Selection Menu disflay sets a pattern of presen- 
tation of data throughout the FROJMNG program. Menu heading 
and coluans of data labels resgain consistent in the sonitor 
sodes of operation, in the student mode of operation and in 
the display of data for the report subrmission tables. With 
the capability to froduce plate displays, these factors 
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could be set into a file to he overlaid onto the screen. 
Items inthe table are excellent candidates for a flate 
information display. The plate display capability would 
enable data item value change on the screen without 
reprinting the display and without the need to indicate 
which ites is to be changed. The user will be able to flace 
the terginal curser onthe data item value, change the 
values as desired, and submit the entire change as cne 
input. 

Net only weuld the plate display simplify data 
change and operation, it would also eliminate the need for 
four cf the subroutines used in PROJMNG. The two change 
routines, the PAGEIN subroutine and the FINISH subroutines 
could te ccmbined into one senu with the Selection Menu 
format. 

Plate display capability would also be useful for 
the Sensitivity Analysis Menu. The format of this display 
could ke changed intc the same format as the Selection Menu. 
Much of the sensitivity analysis routine could be elizinated 
with the saving in lines-of-code which the plate display 
represents. 

The I3M CMS II version currently being isplemented 
at the Naval Postgraduate School (NPS) contains this cara- 
bility. Plate display capability for this program is 
expected to be availatle within the coming academic quarter. 


2. Feccmmendaticr 


Adapt ERCJNNG to display plates as soon as CMS II is 
implemented. 
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I. A SCEUAEIO GENERATING PROGRAM 
1. Biscussion 

Within the ccaputer sisulation environment, concep- 
tual level programs have been demonstrated which permit the 
wser to create his cwn decision support and analysis scen- 
ario. Application of this technology to DMS is envisioned 
as providing a program which can simulate any actual acqui- 
siticn scenario. These ccncept level programs utilize a 
hierarchy of menus tc query the user for arrays to estaklish 
the progranz dimensions. The program then queries the user 
for array size, array nage, variables names, pararzeter 
ranges fer the variakles and relative significance (weight) 
cf the variables within the parameter. A hierarchy of 
menu-driven routines guides the user to create a prcgran 
which sufports the scenario to be studied. These prograags 
enable the user to vary input variables in a matrix of 
parameters. The user constructs a scenari». based on his 
concept of the parameters, on his feeling of their 
interaction and their relative significance. Based on these 
user perceptions such a program creates predictions fcr the 
effects cf the parazeter interaction. These predictions are 
heavily weighted by user bias to parameter interacticn. 
Usually the program results predict what the user envisioned 
because cf the ispact of his riases. The main benefit of 
scenario creation has proven to be the opportunity for the 
user to conduct a detailed managegzent study of the situation 
Eeing sodelled. 


2. Kecousendation 


Levelop a prccraa whose design would permit preject 
managers to create frogram sigulations tailored to assess 
their specific real-werld scenarios. 
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J. USE EROJANG TO ENCOMPASS OTHER CNP VARIATIONS 


1. FEissussion 


Ihe design of PROJMNG around CNP routines with its 
cwn routines performing the features which make it different 
from CNP sakes it pcessible for PROJMNG to encompass cther 
CNP variations. Any CNP style program which has the sane 
common buffer of data could utilize PROJMNG's enhancements. 
the buffer of common variables in PROJMNG has been editted 
from that ccntained in CNP. The CNP buffer can be restored 
into FROJMEG, and does permit PROJANG operation. 

The design of PROJMNG routines to support the calcu- 
laticns ckhtained in CNP suggest the potential of PROJMNG as 
a set of routines to enhance the user-friendliness of cther 
programs. Frograms which could generate the same jata iteas 
as CNF could be used as a nucleus program whose data would 
ke used ty FROJMNG routines to conduct sensitivity analysis. 
j Frogrags which are candidates for consideration are: 

e the main DMS batch gaze 
e the latest ICAF DMS version (SAFE 84) 
e the Swedish version called PMG/ZEBRA 


2. Reccamendatics 
Investigate the use of PROJMNG as is or aodified to 
ke ccapatible with the latest ICAF DMS version (SAFE 84) and 
the Swedish version called PMG/ZEBRA. Test the concert of 
using PROJMNG as an enhancement to the other aanagement 
acquisition prograas. 
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DEFENSE MANAGEMENT SIMULATION 
DECISION SHEET 3 
1. Of the total funds approved by the Secretary of Defense, the following 
distribution is made for procurement of the ZEBRA Weapon Svstem: 


$ ._ __ Million [1-4] 


a. Development Phase 


b. Production Phase — Million [5-8] | 


2. The Development Contractor selected for ZEBRA System development 
is: (enter appropriate contractor number) 


a. Midas Missile Corporation (contractor 1) 
b. Apex Aerospace, Incorporated (contractor 2) [9} 


3. The basic guidance approach selected for the ZEBRA System is: 
(enter appropriate approach number) 


a. Radar Inertial Guidance (G-1} (approach 1) 
b. All-Inertial Guidance (G-2) (approach 2) __ [10) 


4, The guidance configuration selected for development is: 
(enter appropriate configuration number) 


a. "Al as primary, '"B" as parallel (configuration 1) 


b. "A" alone (configuration 2) 
c. "B" as primary, "A" as paraliel (configuration 3) 
d. 'B" alone (configuration 4) {12j 


5. The development contract to be «cgotiated contains th- 
following features: 


a. Funds for the following activities. These funds are 
included in the total target development cost: 


(1) Maintainability Engineering $ -_ ___ Million [12-15] 


(2) Value Engineering $ ~___ __ Million [16-19] 


(3) Parallel Guidance Development 
(ente. § where not desired) $ -__-___ Million [20-23] 


DECISION SHEET 3 


we 


b. The following minimum technical performance characteristics: 
(demonstrated at completion of flight tests) 


ee 


SN 
“ 


(1) Motor Sub-system Reliability : % [24-26] 


4 


HRN XO 
b eereryt 


an @ 


(2) Airframe Sub-system Reliability : % [27-29] 


(3) La icher/GSE Sub-system Reliability : % [30-32] 


(4) Fire Control Sub-system Impact Error 


(5) Guidance Sub-system Impact Error 


c. The following numbers of sub-system Qualification Tests: 


oy (1) Motor Sub-system (20-40) [39-401 
wo (2) Airframe Sub-system (3-9) [41] 
} \ (3) Launcher/GSE ‘Sub-system (2-6) [42] 
(4) Fire Control Sub-system (2-4) 143] 


(S) Guidance Sub-system (3-9) __ [44] 


d. The following number of Flight Tests: (10-25) eee [45-46] 


m4 


age 


ff So. 


6. Decision Point 


ais “”, 


Team Number 


ek | Sey 


Card Number 


Set 125 


age ee wb 
eres 
a ass 


oe a 
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DECISICN SHEET 3 


to negotiations) are as follows: 


NOTE: 


for the maximum fee percentage. 
a. Development Program Cost: 


Maximum Cost (minimum fee value) 


Minimum Cost (maximum fee value) 
Maximum Fee Percentage 


Schedule; Completion of Flight Tests: 


“ 
y 
s 


Latest Week (minimum fee value) 


Earliest Week ‘(maximum fee value) 


Maximum Fee Percentage 


c. System Reliability: 


Maximum Reliability 
Minimum Reliability 


Maximum Fee Percentage 


(muximun fee value) 


(mininun fee value) 


Team Number 


7. The incentive provisions for this development contract (subject 


If any area is not incentivized, enter the target value 
for both the maximum and minimum fee values, enter 9 


< w= 3 
| 
$e Million [i-3) 
ys Million [4-6] 
es a ey % {7-9] 
Week Now.  s«:10- 1 2} 
Week Now {13-15} 
catia ae % [16-i8: 
eo tS {19-20] 
% [21-22] 


Per a ee ee 
"aR a Baas ata a te oe 


. 
———— 


% [23-25] 


eee wie ee oP, EL ee ee ee ead 


PN oe aS “atte 
aa Se ihe 


nee 

Sa Team Number 
ae DP-> 
74 oat 7 
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DECISION SHEET 3 

RS . 

39 

he d. System Impact Error: 

we 

ee Maximum Error (poorest accuracy) 

ee (minimum fee value) yards [26-28] 
PN) _— = 

es 

ia Minimum Error (best accuracy) 

bt (maximum fee value) ___ yards [29-31] 
asl Maximum Fee Percentage oad Nee cs % [32-34] 
me 

hel 

fn 

x 8. Production Decisions: 

Ped a. The desired date for completion of 

338 deployment of lot TEN is: . Week No. __ __ [44-46] 
Bs b. Fabrication of Block I missiles is to start after: 
“UO 

oy (1) Qualification Tests 

“re [concurrent (fabrication 1)] 

pe, (2) Flight Tests 

eel, (fly-before-buy (fabrication 2)] (lor 2) [47] 
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Team Number 
DP-4 
DEFENSE MANAGEMENT SIMULATION 
DECISION SHEET 4 
1. The Development Contractor selected for ZEBRA System development 
4s: (enter appropriate contractor number) 


a. Midas Missile Corporation (contractor 1) 


b. Apex Aerospace, Incorporated (contractor 2) [1] 


2. The basic guidance approach selected for the ZEBRA System is: 
(enter appropriate approach number) 


a. Radar Inertial Guidance (G-1) (approach 1) 


b. All-Inertial Guidance (G-2) (approach 2) {2] 


3. The final guidance configuration selected for development and 
production is: (enter appropriate configuration number) 
a. "A' configuration (configuration 2) 
b. "B configuration (configuration 4) __ [3] 
4. The revissd development contract contains the following 
features: 
a. Funds for the fuil«wing accivities: 
(If you do not desire to expend additional funds in these 
areas, enter the a iate amounts expended at DP-3. 
If you do desire to expend additional Panda in these 
areas, enter the total amounts you now desire.) 
(1) Maintainability Engineering $_.CMililion [4-6] 
(2) Value Engineering $s sCMillion [7-9] 


bd. [Fue Monitor's Use Only] o 00 {20-12} 
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c. The foliowing miniwum technicel performance characteristics: 
(demonstrated at completion of flischt tests) 


(1) Motor Sub-system Reliability -____ % [33-35] 


(2) Airframe Sub-system Reliability % [36-38] 


a eo 


(3) Launcher/GSE Sub-system Reliability -___ * [39-41] 


(4) Fire Control Sub-system Impact Error __ yards [42-44] 


(5) Guidance Sub-system Impact Error __ yards [45-+7] 


d. The ‘ollowing numbers of sub-system Quilification Tests: 


pe (1) Moto: Sub-system (20-40) ____ [48-49] 
(2) Airframe Sub-system (3-9) __ [50] 
(5) Launcher/GSE Sub-system (2-6) __ [si] 
(4) Fire Control Sub-system (2-4) . __ [52] 
(5) Guidance Sub-systea (3-9) __ [53] 
e. The following m«iber of Flight Tests: (10-25) _ ___ [54-55] 


S. Decision Point 
Team Number 
ol Card Number 
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Team Number ae, 


. DP--+ 


The incentive provisions for this development contract (subject 
to negotiations) are as follows: 


NOTE: 


If any area is not incentivized, enter the target value 


for both the maximum and minimum fee values, enter # 
for the maximum fee percentage. 


a. Development Program Cost: 


Maximum Cost 
Miniaum Cost 


(minimum fee value) 
(maximum fee value) 


Maximum Fee Percentage 


b. Schedule; 


Latest Week 


Earliest Week 


Completion of Flight Tests: 


(minimum fee value) 


(maxigum fee value) 


Maximum Fee Percentage 


c. System Reliability: 


Maximus Reliability 
Minimum Reliability 


Maximum Fee Percentage 
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(maximum fee value) 
(aininus fee value) 


__.___ Million [1-3] 
__*___ Million [4-6] 


% {7-9} 


Week Now. [10-12] 
Week No. __Sséi(15-5 ] 
= -___ * [16-18] 


___ __ & [19-20] 
__ __ & [21-22] 
____ & [23-25] 
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d. System Impact Error: 


Maximum Error (poorest accuracy) 


(minimum fee value) __ yards [26-28] 


Minigum Error (best accuracy) 


(maximum fee value) __ yards [29-31] 


Maximum Fee Percentage __% (32-34] 


~s 


. Production Decisions: 


a. The Development Contractor is to procure the following 


number of lots of long-lead time components in 
preparation for Block I production: 


b. The earliest Lot TEN deployment date for which fixed 
price proposals are desired is: 


Week No. —_.«*([46-48] 
c. Fabrication of Block I missiles is to start after: 


(1) Qualification Tests 
(concurrent (fabrication 1)] 


(2) Flight Tests 
[fly-before-buy (fabrication 2)] (lor 2) [49] 


8. Class 
Decision Point 
Team Nurmber 
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